Light field vision-correction device

ABSTRACT

Devices utilizing holographic 4D plenoptic capture and display technologies to generate a light field function to provide glasses-less vision correction for observers with imperfect vision, and to project an image according to the generated light field function, and methods for calibrating a four-dimensional light field for a user with an uncorrected visual acuity.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of priority to U.S. ProvisionalPatent Application No. 62/617,293, entitled “Novel Application ofHolographic and Light Field Technology,” filed Jan. 14, 2018, which areboth herein incorporated by reference in their entirety.

TECHNICAL FIELD

This disclosure generally relates to light field energy systems, andmore specifically, to systems incorporating novel syntheses andapplications of holographic and light field technology to calibrate alight field display system for the vision of individual users.

BACKGROUND

The dream of an interactive virtual world within a “holodeck” chamber aspopularized by Gene Roddenberry's Star Trek and originally envisioned byauthor Alexander Moszkowski in the early 1900s has been the inspirationfor science fiction and technological innovation for nearly a century.However, no compelling implementation of this experience exists outsideof literature, media, and the collective imagination of children andadults alike.

SUMMARY

Disclosed are light field energy devices and systems having novelsyntheses and application of holographic and light field technology forcalibrating a light field display system for the vision of individualusers, and methods thereof.

In one embodiment, a vision-correction device includes a light-sourcesystem able to provide light to a plurality of light locations andhaving a plurality of light sources, and a light-directing system havingan array of waveguides able to direct light emitted by the plurality oflight sources along a plurality of propagation paths where eachpropagation path extends through one of the plurality of lightlocations. A first waveguide of the array of waveguides is able todirect light from a first light location through the first waveguidealong a first propagation path of the plurality of propagation pathswhere the first propagation path extends from the first waveguide in aunique direction determined at least by the first light location. In oneembodiment, the device further includes a control system able to operatethe plurality of light sources to direct light through thelight-directing system to project a first holographic object along theplurality of propagation paths according to a four-dimensional (“4D”)light field function that has been determined to account for anuncorrected visual acuity of a first user, whereby the first holographicobject is perceivable by the first user with a first corrected visualacuity.

In another embodiment, the first waveguide defines a two-dimensional(2D) spatial coordinate, and where the unique direction determined atleast by the first light location includes a two-dimensional angularcoordinate, where the 2D spatial coordinate and the 2D angularcoordinate form a 4D light field coordinate set. In one embodiment, thecontrol system is further able to operate the plurality of light sourcesto direct light through the light-directing system to project a first 2Dobject according to the 4D light field function that has been determinedto account for the uncorrected visual acuity of the first user, wherethe projected object is perceivable by the first user with the firstcorrected visual acuity. In some embodiments, the first 2D objectincludes a page of a book or a Snellen eye chart.

In one embodiment, the control system is further able to operate theplurality of light sources to direct light through the light-directingsystem to project a first stereoscopic object according to the 4D lightfield function that has been determined to account for the uncorrectedvisual acuity of the first user, where the first stereoscopic object isperceivable by the first user with the first corrected visual acuity. Insome embodiments, the 4D light field function accounts for myopia in theuncorrected visual acuity of the first user, hyperopia in theuncorrected visual acuity of the first user, astigmatism in theuncorrected visual acuity of the first user, presbyopia in theuncorrected visual acuity of the first user, a plurality of visualimperfections in the uncorrected visual acuity of the first user, amongothers.

In one embodiment, the 4D light field function accounts for theuncorrected visual acuity of the first user, where the uncorrectedvisual acuity is correctable by an optical power correction. In anotherembodiment, the uncorrected visual acuity includes a plurality ofuncorrected visual sub-acuities of the first user where the first userperceives all visible objects equidistant to the first user with thesame uncorrected visual sub-acuity, and where the 4D light fieldfunction further simultaneously accounts for the plurality ofuncorrected visual sub-acuities by a plurality of simultaneous opticalpower corrections, each optical power correction corresponding to anuncorrected visual sub-acuity. In one embodiment, the light directedalong the first propagation path through the first waveguidesubstantially fills a first aperture of the first waveguide. In anotherembodiment, the light-directing system further includes a firstlight-inhibiting element positioned to limit propagation of light alonga portion of the plurality of propagation paths that do not extendthrough the first aperture. In yet another embodiment, the firstlight-inhibiting element includes a baffle structure for attenuating ormodifying the portion of propagation paths that do not extend throughthe first aperture.

In one embodiment, the light-directing system further includes a secondwaveguide of the array of waveguides able to direct light from a secondlight location through the second waveguide along a second propagationpath of the plurality of propagation paths, where the second propagationpath extends from the second waveguide in a unique direction determinedat least by the second light location.

In one embodiment, the light directed along the second propagation paththrough the second waveguide substantially fills a second aperture ofthe second waveguide, and the light-directing system further includes asecond light-inhibiting element positioned to limit propagation of lightalong a portion of propagation paths that do not extend through thesecond aperture. In one embodiment, the second light-inhibiting elementincludes a baffle structure for attenuating or modifying propagationpaths. In one embodiment, the light directed along the first propagationpath converges with light directed along the second propagation path.

In one embodiment, the vision-correction device further includes anenergy-sensing system able to sense energy data, and a trackingprocessor able to determine the location of the first user based on theenergy data received from the energy-sensing system. In someembodiments, the 4D light field function has also been determined toaccount for the location of the first user so the first holographicobject is perceivable by the first user with the first corrected visualacuity when the first user is at one of a continuum of distances fromthe device for vision correction. In other embodiments, the trackingprocessor tracks the location of the eyes of the one or more users. Insome other embodiments, the uncorrected visual acuity includes a leftuncorrected visual acuity for the left eye of a first user, and a rightuncorrected visual acuity for the right eye of a first user, where the4D light field function accounts for the left uncorrected visual acuityand the right uncorrected visual acuity.

In one embodiment, the control system is able to operate the pluralityof light sources to direct light through the light-directing system toproject a second holographic object according to a second 4D light fieldfunction that has been determined to account for an uncorrected visualacuity of a second user, whereby the second holographic object isperceivable by the second user with a second corrected visual acuity.

In one embodiment, the control system is configured to project the firstholographic object to a first-viewing zone and project the secondholographic object to a second-viewing zone. In one embodiment, thelocation of the first-viewing zone and the location of thesecond-viewing zone are determined by the location of the first user andthe second user. In one embodiment, the tracking processor is able todynamically track the location of the first and second users based onenergy data received from an energy-sensing system, and where thelocation of the first-viewing zone follows the movement of the firstuser and the location of the second-viewing zone follows the movement ofthe second user.

In one embodiment, the vision-correction device further includes anenergy-sensing system able to sense energy data, and a trackingprocessor configured to determine the location of the first and secondusers based on the energy data received from the energy-sensing system.In one embodiment, the energy-sensing system includes a plurality ofcameras that capture image data, and where the tracking processorfurther analyzes the image data to determine the location of the firstand second users. In one embodiment, the second 4D light field functionhas also been determined to account for the location of the second userso the second holographic object is perceivable by the second user withthe second corrected visual acuity when the second user is at one of acontinuum of distances from the device for vision correction. In oneembodiment, the energy-sensing system includes at least one depthsensor, and where the tracking processor further analyzes data generatedby the depth sensor to determine the location of the first and secondusers. In one embodiment, the energy-sensing system is able to generatedata describing a 4D light field by sensing light received at aninterface, and where the tracking processor further analyzes the datadescribing a 4D light field to determine the location of the first andsecond users. In some embodiments, the tracking processor tracks thelocation of the eyes of the first and second users. In otherembodiments, the uncorrected visual acuity includes a left uncorrectedvisual acuity for the left eye of the first user, and a rightuncorrected visual acuity for the right eye of the first user, and the4D light field function further simultaneously accounts for the leftuncorrected visual acuity and for the right uncorrected visual acuity.

In one embodiment, the vision-correction device further includes thelight-source system having a relay system, where the relay systemincludes one or more relay elements, where each of the one or more relayelements includes a first surface and a second surface, and where theplurality of light sources are disposed at the second surface of the oneor more relay elements, the one or more relay elements able to directlight emitted by the plurality of light sources through the first andsecond surfaces to the plurality of light locations.

In one embodiment, the second surfaces of the one or more relay elementsare arranged to form a singular seamless energy surface. In anotherembodiment, the device further includes a light-sensing system able togenerate data describing a 4D light field by sensing light received atan interface. In one embodiment, the light-sensing system and thelight-directing system form a bi-directional energy surface able tosimultaneously sense energy and project the first holographic object. Inanother embodiment, the device further includes a memory incommunication with a processor and where the processor instructs thememory to store the 4D light field function in the memory.

In one embodiment, a device for determining a visually corrective 4Dfunction includes a light-source system able to provide light to aplurality of light locations and having a plurality of light sources, alight-directing system having an array of waveguides able to directlight from the plurality of light sources along a plurality ofpropagation paths where each propagation path extends through one of theplurality of light locations, and where a first waveguide is able todirect light from a first light location through the first waveguidealong a first propagation path of the plurality of propagation pathswhere the first propagation path extends from the first waveguide in aunique direction determined at least by the first light location. Thedevice further includes a control system in communication with theplurality of light sources able to operate the plurality of lightsources to direct light through the light-directing system to project atest object along the plurality of propagation paths, an interactiveuser interface able to receive a progression of user inputs from a firstuser ranking the visual clarity of the test object, and a processor ableto generate a 4D light field function from the progression of userinputs where the 4D light field function is determined to account for afirst uncorrected visual acuity of the first user.

In one embodiment, the control system is able to iteratively adjust thetest object in a progression of successive diopter and astigmatismcorrections determined by the progression of user inputs ranking thevisual clarity of the test object. In another embodiment, the first testobject includes a plurality of sub-objects perceivable to the first userat a corresponding plurality of perceived distances, where theprogression of user inputs from the first user ranks the visual clarityof the plurality of sub-objects.

In some embodiments, the test object includes a 2D image, a page of abook, a Snellen eye chart, a stereoscopic image, among others. In otherembodiments, light is directed from the first waveguide that definestwo-dimensional (2D) spatial coordinate, and where the unique directiondetermined at least by the first light location includes atwo-dimensional angular coordinate, where the 2D spatial coordinate andthe 2D angular coordinate form a four-dimensional (4D) coordinate set.In one embodiment, light directed along the first propagation paththrough the first waveguide substantially fills a first aperture of thefirst waveguide. In some embodiments, the light-directing system furtherincludes a light-inhibiting element positioned to limit propagation oflight along a portion of propagation paths that do not extend throughthe first aperture. In another embodiment, the light-inhibiting elementincludes a baffle structure for attenuating or modifying propagationpaths.

In some embodiment, the light-directing system further includes a secondwaveguide able to direct light from a second light location through thesecond waveguide along a second propagation path of the plurality ofpropagation paths where the second propagation path extends from thesecond waveguide in a unique direction determined at least by the secondlight location. In other embodiments, the light directed along thesecond propagation path through the second waveguide substantially fillsa second aperture of the second waveguide, and the light-directingsystem further includes a second light-inhibiting element positioned tolimit propagation of light along a portion of propagation paths that donot extend through the second aperture.

In one embodiment, the second light-inhibiting element includes a bafflestructure for attenuating or modifying propagation paths. In oneembodiment, light directed along the first propagation path convergeswith light directed along the second propagation path. In someembodiments, the light-source system further includes a relay system,where the relay system includes one or more relay elements, where eachof the one or more relay elements includes a first surface and a secondsurface, where the plurality of light locations are disposed at thesecond surface of the one the one or more relay elements and the relayelements are able to direct light emitted by the plurality of lightsources through the first and second surfaces to the plurality of lightlocations.

In one embodiment, the second surfaces of the one or more relay elementsare arranged to form a singular seamless energy surface. In anotherembodiment, the device further includes a memory in communication withthe processor and where the processor is configured to instruct thememory to store the 4D light field function. In yet another embodiment,the processor is able to instruct the memory to associate at least oneof a user name of the first user, a user profile of the first user, anda user identification of the first user with the 4D light field functionstored in the memory.

In one embodiment, the processor is able to instruct the memory to storeat least one additional 4D light field function where the at least oneadditional 4D light field function is determined to account for a firstuncorrected visual acuity of at least one additional user, and where theprocessor is configured to instruct the memory to associate at least oneof a user name of the least one additional user, a user profile of theleast one additional user, and a user identification of the least oneadditional user with the least one additional 4D light field functionstored in the memory.

In one embodiment, the control system is further able to operate theplurality of light sources to direct light through the light-directingsystem to project a first holographic object according to the 4D lightfield function, whereby the first holographic object is perceivable bythe first user with a first corrected visual acuity. In someembodiments, the device further includes an energy-sensing system ableto sense energy data, and a tracking processor able to determine thelocation of the first user based on the energy data received from theenergy-sensing system.

In one embodiment, the 4D light field function has also been determinedto account for the location of the first user so the first holographicobject is perceivable by the first user with the first corrected visualacuity when the first user is at one of a continuum of distances fromthe device for vision correction. In another embodiment, the trackingprocessor tracks the location of the eyes of the one or more users. Inyet another embodiment, the uncorrected visual acuity includes a leftuncorrected visual acuity for the left eye of a first user, and a rightuncorrected visual acuity for the right eye of a first user, where the4D light field function accounts for the left uncorrected visual acuityand the right uncorrected visual acuity.

In one embodiment, the control system is able to operate the pluralityof light sources to direct light through the light-directing system toproject a second holographic object according to a second 4D light fieldfunction that has been determined to account for an uncorrected visualacuity of a second user, whereby the second holographic object isperceivable by the second user with a second corrected visual acuity. Inanother embodiment, the control system is configured to project thefirst holographic object to a first-viewing zone and project the secondholographic object to a second-viewing zone. In yet another embodiment,the location of the first-viewing zone and the location of thesecond-viewing zone are determined by the location of the first user andthe second user. In one embodiment, a tracking processor is able todynamically track the location of the first and second users based onenergy data received from an energy-sensing system, and where thelocation of the first-viewing zone follows the movement of the firstuser and the location of the second-viewing zone follows the movement ofthe second user.

In one embodiment, the device further includes an energy-sensing systemable to sense energy data related to the location of the first andsecond users, and a tracking processor able to determine the location ofthe first and second users based on the energy data received from theenergy-sensing system. In one embodiment, the energy-sensing systemincludes a plurality of cameras that capture image data, and where thetracking processor analyzes the image data to determine the location ofthe first and second users. In another embodiment, the second 4D lightfield function has also been determined to account for the location ofthe second user so the second holographic object is perceivable by thesecond user with the second corrected visual acuity when the second useris at one of a continuum of distances from the device for visioncorrection.

In one embodiment, the energy-sensing system includes at least one depthsensor, and where the tracking processor analyzes data generated by thedepth sensor to determine the location of the first and second users. Inanother embodiment, the energy-sensing system is able to generate datadescribing a 4D light field by sensing light received at an interface,and where the tracking processor analyzes the data describing a 4D lightfield to determine the location of the first and second users.

In one embodiment, the tracking processor tracks the location of theeyes of the first and second users. In another embodiment, theuncorrected visual acuity includes a left uncorrected visual acuity forthe left eye of the first user, and a right uncorrected visual acuityfor the right eye of the first user, and where the 4D light fieldfunction simultaneously accounts for the left uncorrected visual acuityand for the right uncorrected visual acuity.

In one embodiment, the light-source system includes a relay system,where the relay system includes one or more relay elements, where eachof the one or more relay elements includes a first surface and a secondsurface, and where the plurality of light sources are disposed at thesecond surface of the one or more relay elements, the one or more relayelements configured to direct light emitted by the plurality of lightsources through the first and second surfaces to the plurality of lightlocations.

In one embodiment, the second surfaces of the one or more relay elementsare arranged to form a singular seamless energy surface. In anotherembodiment, the device further includes a light-sensing system able togenerate data describing a 4D light field by sensing light received atan interface. In one embodiment, the light-sensing system and thelight-directing system form a bi-directional energy surface able tosimultaneously sense energy and project the first holographic object.

In one embodiment, the control system is further able to operate theplurality of light sources to direct light through the light-directingsystem to project a first 2D object along the plurality of propagationpaths according to the 4D light field function that has been determinedto account for the uncorrected visual acuity of the first user, wherebythe first 2D object is perceivable by the first user with the firstcorrected visual acuity.

In some embodiments, the first 2D object includes a page of a book, or aSnellen eye chart, among others. In other embodiments, the controlsystem is further able to operate the plurality of light sources todirect light through the light-directing system to project a firststereoscopic object according to the 4D light field function that hasbeen determined to account for the uncorrected visual acuity of thefirst user, whereby the first stereoscopic object is perceivable by thefirst user with the first corrected visual acuity.

In some embodiments, the 4D light field function accounts for myopia inthe uncorrected visual acuity of the first user, hyperopia in theuncorrected visual acuity of the first user, astigmatism in theuncorrected visual acuity of the first user, presbyopia in theuncorrected visual acuity of the first user, among others. In otherembodiments, the 4D light field function simultaneously accounts for aplurality of visual imperfections in the uncorrected visual acuity ofthe first user.

In one embodiment, the 4D light field function accounts for theuncorrected visual acuity of the first user, where the uncorrectedvisual acuity is correctable by an optical power correction. In anotherembodiment, the uncorrected visual acuity includes a plurality ofuncorrected visual sub-acuities of the first user where the first userperceives all visible objects equidistant to the user with the same thevisual sub-acuity, and where the 4D light field function simultaneouslyaccounts for the plurality of uncorrected visual sub-acuities by aplurality of simultaneous optical power corrections, each optical powercorrection corresponding to an uncorrected visual sub-acuity.

In one embodiment, a method for calibrating a four dimensional (‘4D”)light field display to project a holographic object according to a 4Dlight field function for a user with an uncorrected visual acuityincludes the steps of: projecting a test object, iteratively adjustingthe projection of the test object according to a progression of userinputs evaluating the clarity of the test object, generating a 4D lightfield function according to the progression of user inputs evaluatingthe clarity of the test objects that compensates for vision problems ofthe user, and using the 4D light field function to project a holographicobject calibrated to correct vision problems of the user.

In one embodiment, adjusting the test object step includes a progressionof successive diopter and astigmatism corrections. In some embodiments,the test object includes a two-dimensional (“2D”) object or a Snelleneye chart, among others. In one embodiment, the method includes the userevaluating the clarity of the test object by reading lines on theSnellen eye chart. In some embodiments, the test object includes aplurality of sub-objects, each sub-object being projected at a uniquedepth in the user's field of view. In other embodiments, evaluating theclarity of the test object includes evaluating the clarity of eachsub-object.

In some embodiments, the 4D light field function accounts for a userwith myopia, a user with hyperopia, a user with astigmatism in theuncorrected visual acuity of the user, a user with presbyopia, a userwith a plurality of visual imperfections in the uncorrected visualacuity of the user, among others. In other embodiment, the method may berepeated for additional users to project additional holographic objectscalibrated to account for vision problems of the additional users.

In one embodiment, the 4D light field display includes a trackingprocessor able to dynamically track users based on data received from anenergy-sensing system to project the holographic objects. In anotherembodiment, the 4D light field display is able to project eachholographic object to a viewing zone for a corresponding user. In yetanother embodiment, the viewing zones follow the movement of the user.In one embodiment, the 4D light field function also accounts for thelocation of the users to correct vision problems when the users arelocated at different distances form the 4D light field display. Inanother embodiment, the tracking processor is able to track the locationof the eyes of the users. In yet another embodiment, the 4D light fieldfunction accounts for users with a vision problem that varies from theright eye to the left eye. In another embodiment, the 4D light fieldfunction is able to project a 2D object calibrated to correct for visionproblems of the users. In one embodiment, the 4D light field function isable to project a stereoscopic object calibrated to correct for visionproblems of the users.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram illustrating design parameters for anenergy directing system;

FIG. 2 is a schematic diagram illustrating an energy system having anactive device area with a mechanical envelope;

FIG. 3 is a schematic diagram illustrating an energy relay system;

FIG. 4 is a schematic diagram illustrating an embodiment of energy relayelements adhered together and fastened to a base structure;

FIG. 5A is a schematic diagram illustrating an example of a relayedimage through multi-core optical fibers;

FIG. 5B is a schematic diagram illustrating an example of a relayedimage through an optical relay that exhibits the properties of theTransverse Anderson Localization principle;

FIG. 6 is a schematic diagram showing rays propagated from an energysurface to a viewer;

FIG. 7A illustrates a cutaway view of a flexible energy relay whichachieves Transverse Anderson Localization by intermixing two componentmaterials within an oil or liquid, in accordance with one embodiment ofthe present disclosure;

FIG. 7B illustrates a cutaway view of a rigid energy relay whichachieves Transverse Anderson Localization by intermixing two componentmaterials within a bonding agent, and in doing so, achieves a path ofminimum variation in one direction for one critical material property,in accordance with one embodiment of the present disclosure;

FIG. 8 illustrates a cutaway view in the transverse plane the inclusionof a DEMA (dimensional extra mural absorption) material in thelongitudinal direction designed to absorb energy, in accordance with oneembodiment of the present disclosure;

FIG. 9 illustrates a side view of three display devices which eachcomprise an active display area dimension and a mechanical envelope;

FIG. 10 features five display devices which each comprise active displayareas and mechanical envelopes, used with a beam splitter;

FIG. 11 is a side view illustration of a methodology where 3 beamsplitters are leveraged to accommodate a mechanical envelope;

FIG. 12 highlights this relationship between the mechanical enveloperatio, the minimum focus distance and the maximum image offset as wellas the percent of overlap between individual tiled images;

FIG. 13 is a top view illustration of an embodiment with threeprojection devices arranged in an arc;

FIG. 14 illustrates a tapered energy relay mosaic arrangement;

FIG. 15 illustrates a side view of an energy relay element stackcomprising of two compound optical relay tapers in series;

FIG. 16 illustrates a perspective view of an embodiment of an energydirecting device where energy relay element stacks are arranged in an8×4 array to form a singular seamless energy directing surface;

FIG. 17 contains several views of an energy directing device.

FIG. 18 contains a close-up view of the side view from FIG. 17 of theenergy directing device;

FIG. 19 illustrates a top view of an embodiment where energy relayelement stacks are angled inward to a known point in space;

FIG. 20 is a top view illustration of an embodiment where the seamlessenergy surface is a display formed by tapered optical relays, while thedisplay devices and the mechanical envelopes for the display electronicsare located a distance away from the tapered relays;

FIG. 21 is a side view illustration of an embodiment wherein a seamlessdisplay surface is composed of nine tapered optical relays;

FIG. 22 illustrates a top-down perspective view of an embodiment of anenergy waveguide system operable to define a plurality of energypropagation paths;

FIG. 23 illustrates a front perspective view of the embodiment shown inFIG. 22;

FIGS. 24A-H illustrate various embodiments of an energy inhibitingelement;

FIG. 25 illustrates an additional embodiment of an energy waveguidesystem;

FIG. 26 illustrates an additional embodiment of an energy waveguidesystem;

FIG. 27 highlights the differences between square packing, hex packingand irregular packing for energy waveguide design considerations;

FIG. 28 illustrates an embodiment featuring an array of energywaveguides arranged in a curved configuration;

FIG. 29 illustrates an embodiment that highlights how a waveguideelement may affect a spatial distribution of energy passingtherethrough;

FIG. 30 illustrates an additional embodiment which further highlightshow a waveguide element may affect a spatial distribution of energypassing therethrough;

FIG. 31 illustrates an embodiment wherein the plurality of energywaveguides comprise diffractive waveguide elements;

FIG. 32 illustrates a lenslet configuration used to provide full densityof ray illumination for the desired angle of view.

FIGS. 33A-33D illustrate four perspective views of tiling multipleenergy systems to form a seamless environment, in accordance with fourembodiments of the present disclosure;

FIG. 33E illustrates the curved waveguide surface and energy devices ofan energy waveguide system, in accordance with one embodiment of thepresent disclosure;

FIG. 34A illustrates a waveguide element exhibiting a non-regulardistribution of energy, in accordance with one embodiment of the presentdisclosure;

FIG. 34B illustrates an orthogonal view of a table-mounted energywaveguide system, in accordance with one embodiment of the presentdisclosure;

FIG. 34C illustrates an orthogonal view of a table-mounted waveguidesystem with an additional reflective waveguide elements, in accordancewith one embodiment of the present disclosure;

FIG. 35 illustrates an orthogonal view of a floor-mounted tiled energywaveguide system, in accordance with one embodiment of the presentdisclosure;

FIG. 36 illustrates an orthogonal view of a spherical structure where aviewing volume is surrounded by tiled energy waveguide systems, inaccordance with one embodiment of the present disclosure;

FIG. 37 illustrate an orthogonal view of five viewer locations within aviewing volume and five energy coordinates under each waveguide topropagate a plurality of rays to each viewer location that is unique toa single viewer location, in accordance with one embodiment of thepresent disclosure;

FIG. 38A illustrates an energy relay combining device, in accordancewith one embodiment of the present disclosure;

FIG. 38B illustrates a further embodiment of FIG. 38A, in accordancewith one embodiment of the present disclosure;

FIG. 38C illustrates an orthogonal view of an implementation of anenergy waveguide system, in accordance with one embodiment of thepresent disclosure;

FIG. 39 illustrates an orthogonal view of another implementation of anenergy waveguide system, in accordance with one embodiment of thepresent disclosure;

FIG. 40 illustrates an orthogonal view of yet another implementation, inaccordance with one embodiment of the present disclosure;

FIG. 41 illustrates a system for correcting vision in a nearsightedviewer;

FIG. 42 illustrates a system for correcting vision in a farsightedviewer;

FIG. 43 illustrates a comparison between the perceived images seen byviewers with nearsightedness and farsightedness, and with visioncorrection applied;

FIG. 44 illustrates an embodiment of a vision-correction devicecalibrated to project a holographic object;

FIG. 45A illustrates an uncorrected visual acuity of a person in thereal world;

FIG. 45B illustrates a corrected visual acuity of a user viewing aholographic objected projected according to a 4D light field functiondetermined to account for an uncorrected visual acuity;

FIG. 46A illustrates an embodiment of a vision-correction devicecalibrated to project a two-dimensional object;

FIG. 46B illustrates an embodiment of a vision-correction devicecalibrated to project a Snellen eye chart;

FIG. 47 illustrates an embodiment of a vision-correction devicecalibrated to project a stereoscopic object;

FIG. 48A illustrates a projected object as perceived by a user with anuncorrected visual acuity;

FIG. 48B illustrates a projected object as perceived by a user with apartially corrected visual acuity;

FIG. 48C illustrates a projected object as perceived by a user with acorrected visual acuity;

FIG. 49 illustrates an embodiment of a vision-correcting device thatprojects different objects to different eyes;

FIG. 50A illustrates an embodiment of a vision-correcting device thatprojects different objects to different users;

FIG. 50B illustrates another embodiment of a vision-correcting devicethat projects different objects to different users;

FIG. 51 illustrates an embodiment of a vision-correcting device thatgenerates a 4D light field function determined to account for anuncorrected visual acuity of a user;

FIG. 51A illustrates a first iteration of a test object;

FIG. 51B illustrates a second iteration of a test object;

FIG. 52, FIG. 53, and FIG. 54 illustrate how a 4D light field functioncan be generated to account for multiple uncorrected visual acuities;and

FIG. 55 illustrates a method for calibrating a 4D light field display.

DETAILED DESCRIPTION

An embodiment of a Holodeck (collectively called “Holodeck DesignParameters”) provide sufficient energy stimulus to fool the humansensory receptors into believing that received energy impulses within avirtual, social and interactive environment are real, providing: 1)binocular disparity without external accessories, head-mounted eyewear,or other peripherals; 2) accurate motion parallax, occlusion and opacitythroughout a viewing volume simultaneously for any number of viewers; 3)visual focus through synchronous convergence, accommodation and miosisof the eye for all perceived rays of light; and 4) converging energywave propagation of sufficient density and resolution to exceed thehuman sensory “resolution” for vision, hearing, touch, taste, smell,and/or balance.

Based upon conventional technology to date, we are decades, if notcenturies away from a technology capable of providing for all receptivefields in a compelling way as suggested by the Holodeck DesignParameters including the visual, auditory, somatosensory, gustatory,olfactory, and vestibular systems.

In this disclosure, the terms light field and holographic may be usedinterchangeably to define the energy propagation for stimulation of anysensory receptor response. While initial disclosures may refer toexamples of electromagnetic and mechanical energy propagation throughenergy surfaces for holographic imagery and volumetric haptics, allforms of sensory receptors are envisioned in this disclosure.Furthermore, the principles disclosed herein for energy propagationalong propagation paths may be applicable to both energy emission andenergy capture.

Many technologies exist today that are often unfortunately confused withholograms including lenticular printing, Pepper's Ghost, glasses-freestereoscopic displays, horizontal parallax displays, head-mounted VR andAR displays (HMD), and other such illusions generalized as“fauxlography.” These technologies may exhibit some of the desiredproperties of a true holographic display; however, lack the ability tostimulate the human visual sensory response in any way sufficient toaddress at least two of the four identified Holodeck Design Parameters.

These challenges have not been successfully implemented by conventionaltechnology to produce a seamless energy surface sufficient forholographic energy propagation. There are various approaches toimplementing volumetric and direction multiplexed light field displaysincluding parallax barriers, hogels, voxels, diffractive optics,multi-view projection, holographic diffusers, rotational mirrors,multilayered displays, time sequential displays, head mounted display,etc., however, conventional approaches may involve a compromise on imagequality, resolution, angular sampling density, size, cost, safety, framerate, etc., ultimately resulting in an unviable technology.

To achieve the Holodeck Design Parameters for the visual, auditory,somatosensory systems, the human acuity of each of the respectivesystems is studied and understood to propagate energy waves tosufficiently fool the human sensory receptors. The visual system iscapable of resolving to approximately 1 arc min, the auditory system maydistinguish the difference in placement as little as three degrees, andthe somatosensory system at the hands are capable of discerning pointsseparated by 2-12 mm. While there are various and conflicting ways tomeasure these acuities, these values are sufficient to understand thesystems and methods to stimulate perception of energy propagation.

Of the noted sensory receptors, the human visual system is by far themost sensitive given that even a single photon can induce sensation. Forthis reason, much of this introduction will focus on visual energy wavepropagation, and vastly lower resolution energy systems coupled within adisclosed energy waveguide surface may converge appropriate signals toinduce holographic sensory perception. Unless otherwise noted, alldisclosures apply to all energy and sensory domains.

When calculating for effective design parameters of the energypropagation for the visual system given a viewing volume and viewingdistance, a desired energy surface may be designed to include manygigapixels of effective energy location density. For wide viewingvolumes, or near field viewing, the design parameters of a desiredenergy surface may include hundreds of gigapixels or more of effectiveenergy location density. By comparison, a desired energy source may bedesigned to have 1 to 250 effective megapixels of energy locationdensity for ultrasonic propagation of volumetric haptics or an array of36 to 3,600 effective energy locations for acoustic propagation ofholographic sound depending on input environmental variables. What isimportant to note is that with a disclosed bi-directional energy surfacearchitecture, all components may be configured to form the appropriatestructures for any energy domain to enable holographic propagation.

However, the main challenge to enable the Holodeck today involvesavailable visual technologies and electromagnetic device limitations.Acoustic and ultrasonic devices are less challenging given the orders ofmagnitude difference in desired density based upon sensory acuity in therespective receptive field, although the complexity should not beunderestimated. While holographic emulsion exists with resolutionsexceeding the desired density to encode interference patterns in staticimagery, state-of-the-art display devices are limited by resolution,data throughput and manufacturing feasibility. To date, no singulardisplay device has been able to meaningfully produce a light fieldhaving near holographic resolution for visual acuity.

Production of a single silicon-based device capable of meeting thedesired resolution for a compelling light field display may notpractical and may involve extremely complex fabrication processes beyondthe current manufacturing capabilities. The limitation to tilingmultiple existing display devices together involves the seams and gapformed by the physical size of packaging, electronics, enclosure, opticsand a number of other challenges that inevitably result in an unviabletechnology from an imaging, cost and/or a size standpoint.

The embodiments disclosed herein may provide a real-world path tobuilding the Holodeck.

Example embodiments will now be described hereinafter with reference tothe accompanying drawings, which form a part hereof, and whichillustrate example embodiments which may be practiced. As used in thedisclosures and the appended claims, the terms “embodiment”, “exampleembodiment”, and “exemplary embodiment” do not necessarily refer to asingle embodiment, although they may, and various example embodimentsmay be readily combined and interchanged, without departing from thescope or spirit of example embodiments. Furthermore, the terminology asused herein is for the purpose of describing example embodiments onlyand is not intended to be limitations. In this respect, as used herein,the term “in” may include “in” and “on”, and the terms “a,” “an” and“the” may include singular and plural references. Furthermore, as usedherein, the term “by” may also mean “from”, depending on the context.Furthermore, as used herein, the term “if” may also mean “when” or“upon,” depending on the context. Furthermore, as used herein, the words“and/or” may refer to and encompass any and all possible combinations ofone or more of the associated listed items.

Holographic System Considerations Overview of Light Field EnergyPropagation Resolution

Light field and holographic display is the result of a plurality ofprojections where energy surface locations provide angular, color andintensity information propagated within a viewing volume. The disclosedenergy surface provides opportunities for additional information tocoexist and propagate through the same surface to induce other sensorysystem responses. Unlike a stereoscopic display, the viewed position ofthe converged energy propagation paths in space do not vary as theviewer moves around the viewing volume and any number of viewers maysimultaneously see propagated objects in real-world space as if it wastruly there. In some embodiments, the propagation of energy may belocated in the same energy propagation path but in opposite directions.For example, energy emission and energy capture along an energypropagation path are both possible in some embodiments of the presentdisclosed.

FIG. 1 is a schematic diagram illustrating variables relevant forstimulation of sensory receptor response. These variables may includesurface diagonal 101, surface width 102, surface height 103, adetermined target seating distance 118, the target seating field of viewfield of view from the center of the display 104, the number ofintermediate samples demonstrated here as samples between the eyes 105,the average adult inter-ocular separation 106, the average resolution ofthe human eye in arcmin 107, the horizontal field of view formed betweenthe target viewer location and the surface width 108, the vertical fieldof view formed between the target viewer location and the surface height109, the resultant horizontal waveguide element resolution, or totalnumber of elements, across the surface 110, the resultant verticalwaveguide element resolution, or total number of elements, across thesurface 111, the sample distance based upon the inter-ocular spacingbetween the eyes and the number of intermediate samples for angularprojection between the eyes 112, the angular sampling may be based uponthe sample distance and the target seating distance 113, the totalresolution Horizontal per waveguide element derived from the angularsampling desired 114, the total resolution Vertical per waveguideelement derived from the angular sampling desired 115, device Horizontalis the count of the determined number of discreet energy sources desired116, and device Vertical is the count of the determined number ofdiscreet energy sources desired 117.

A method to understand the desired minimum resolution may be based uponthe following criteria to ensure sufficient stimulation of visual (orother) sensory receptor response: surface size (e.g., 84″ diagonal),surface aspect ratio (e.g., 16:9), seating distance (e.g., 128″ from thedisplay), seating field of view (e.g., 120 degrees or +/−60 degreesabout the center of the display), desired intermediate samples at adistance (e.g., one additional propagation path between the eyes), theaverage inter-ocular separation of an adult (approximately 65 mm), andthe average resolution of the human eye (approximately 1 arcmin). Theseexample values should be considered placeholders depending on thespecific application design parameters.

Further, each of the values attributed to the visual sensory receptorsmay be replaced with other systems to determine desired propagation pathparameters. For other energy propagation embodiments, one may considerthe auditory system's angular sensitivity as low as three degrees andthe somatosensory system's spatial resolution of the hands as small as2-12 mm.

While there are various and conflicting ways to measure these sensoryacuities, these values are sufficient to understand the systems andmethods to stimulate perception of virtual energy propagation. There aremany ways to consider the design resolution, and the below proposedmethodology combines pragmatic product considerations with thebiological resolving limits of the sensory systems. As will beappreciated by one of ordinary skill in the art, the following overviewis a simplification of any such system design, and should be consideredfor exemplary purposes only.

With the resolution limit of the sensory system understood, the totalenergy waveguide element density may be calculated such that thereceiving sensory system cannot discern a single energy waveguideelement from an adjacent element, given:

$\mspace{76mu}{{{Surface}\mspace{14mu}{Aspect}\mspace{14mu}{Ratio}} = \frac{{Width}\mspace{14mu}(W)}{{Height}\mspace{14mu}(H)}}$$\mspace{76mu}{{{Surface}\mspace{14mu}{Horizontal}\mspace{14mu}{Size}} = {{Surface}\mspace{14mu}{Diagonal}*\left( \frac{1}{\sqrt{\left( {1 + \left( \frac{H}{W} \right)^{2}} \right.}} \right)}}$$\mspace{76mu}{{{Surface}\mspace{14mu}{Vertical}\mspace{14mu}{Size}} = {{Surface}\mspace{14mu}{Diagonal}*\left( \frac{1}{\sqrt{\left( {1 + \left( \frac{W}{H} \right)^{2}} \right.}} \right)}}$$\mspace{76mu}{{{Horizontal}\mspace{14mu}{Field}\mspace{14mu}{of}\mspace{14mu}{View}} = {2*{{atan}\left( \frac{{Surface}\mspace{14mu}{Horizontal}\mspace{14mu}{Size}}{2*{Seating}\mspace{14mu}{Distance}} \right)}}}$$\mspace{76mu}{{{Vertical}\mspace{14mu}{Field}\mspace{14mu}{of}\mspace{14mu}{View}} = {2*{{atan}\left( \frac{{Surface}\mspace{14mu}{Vertical}\mspace{14mu}{Size}}{2*{Seating}\mspace{14mu}{Distance}} \right)}}}$${{Horizontal}\mspace{14mu}{Element}\mspace{14mu}{Resolution}} = {{Horizontal}\mspace{14mu}{FoV}*\frac{60}{{Eye}\mspace{14mu}{Resolution}}}$$\mspace{76mu}{{{Vertical}\mspace{14mu}{Element}\mspace{14mu}{Resolution}} = {{Vertical}\mspace{14mu}{FoV}*\frac{60}{{Eye}\mspace{14mu}{Resolution}}}}$

The above calculations result in approximately a 32×18° field of viewresulting in approximately 1920×1080 (rounded to nearest format) energywaveguide elements being desired. One may also constrain the variablessuch that the field of view is consistent for both (u, v) to provide amore regular spatial sampling of energy locations (e.g. pixel aspectratio). The angular sampling of the system assumes a defined targetviewing volume location and additional propagated energy paths betweentwo points at the optimized distance, given:

${{Sample}\mspace{14mu}{Distance}} = \frac{{Inter}\text{-}{Ocular}\mspace{14mu}{Distance}}{\left( {{{Number}\mspace{14mu}{of}\mspace{14mu}{Desired}\mspace{14mu}{Intermediate}\mspace{14mu}{Samples}} + 1} \right)}$$\mspace{76mu}{{{Angular}\mspace{14mu}{Sampling}} = {{atan}\left( \frac{{Sample}\mspace{14mu}{Distance}}{{Seating}\mspace{14mu}{Distance}} \right)}}$

In this case, the inter-ocular distance is leveraged to calculate thesample distance although any metric may be leveraged to account forappropriate number of samples as a given distance. With the abovevariables considered, approximately one ray per 0.57° may be desired andthe total system resolution per independent sensory system may bedetermined, given:

${{Locations}\mspace{14mu}{Per}\mspace{14mu}{{Element}(N)}} = \frac{{Seating}\mspace{14mu}{FoV}}{{Angular}\mspace{14mu}{Sampling}}$Total Resolution H=N*Horizontal Element ResolutionTotal Resolution V=N*Vertical Element Resolution

With the above scenario given the size of energy surface and the angularresolution addressed for the visual acuity system, the resultant energysurface may desirably include approximately 400 k×225 k pixels of energyresolution locations, or 90 gigapixels holographic propagation density.These variables provided are for exemplary purposes only and many othersensory and energy metrology considerations should be considered for theoptimization of holographic propagation of energy. In an additionalembodiment, 1 gigapixel of energy resolution locations may be desiredbased upon the input variables. In an additional embodiment, 1,000gigapixels of energy resolution locations may be desired based upon theinput variables.

Current Technology Limitations Active Area, Device Electronics,Packaging, and the Mechanical Envelope

FIG. 2 illustrates a device 200 having an active area 220 with a certainmechanical form factor. The device 200 may include drivers 230 andelectronics 240 for powering and interface to the active area 220, theactive area having a dimension as shown by the x and y arrows. Thisdevice 200 does not take into account the cabling and mechanicalstructures to drive, power and cool components, and the mechanicalfootprint may be further minimized by introducing a flex cable into thedevice 200. The minimum footprint for such a device 200 may also bereferred to as a mechanical envelope 210 having a dimension as shown bythe M:x and M:y arrows. This device 200 is for illustration purposesonly and custom electronics designs may further decrease the mechanicalenvelope overhead, but in almost all cases may not be the exact size ofthe active area of the device. In an embodiment, this device 200illustrates the dependency of electronics as it relates to active imagearea 220 for a micro OLED, DLP chip or LCD panel, or any othertechnology with the purpose of image illumination.

In some embodiments, it may also be possible to consider otherprojection technologies to aggregate multiple images onto a largeroverall display. However, this may come at the cost of greatercomplexity for throw distance, minimum focus, optical quality, uniformfield resolution, chromatic aberration, thermal properties, calibration,alignment, additional size or form factor. For most practicalapplications, hosting tens or hundreds of these projection sources 200may result in a design that is much larger with less reliability.

For exemplary purposes only, assuming energy devices with an energylocation density of 3840×2160 sites, one may determine the number ofindividual energy devices (e.g., device 100) desired for an energysurface, given:

${{Devices}\mspace{14mu} H} = \frac{{Total}\mspace{14mu}{Resolution}\mspace{14mu} H}{{Device}\mspace{14mu}{Resolution}\mspace{14mu} H}$${{Devices}\mspace{14mu} V} = \frac{{Total}\mspace{14mu}{Resolution}\mspace{14mu} V}{{Device}\mspace{14mu}{Resolution}\mspace{14mu} V}$

Given the above resolution considerations, approximately 105×105 devicessimilar to those shown in FIG. 2 may be desired. It should be noted thatmany devices consist of various pixel structures that may or may not mapto a regular grid. In the event that there are additional sub-pixels orlocations within each full pixel, these may be exploited to generateadditional resolution or angular density. Additional signal processingmay be used to determine how to convert the light field into the correct(u,v) coordinates depending on the specified location of the pixelstructure(s) and can be an explicit characteristic of each device thatis known and calibrated. Further, other energy domains may involve adifferent handling of these ratios and device structures, and thoseskilled in the art will understand the direct intrinsic relationshipbetween each of the desired frequency domains. This will be shown anddiscussed in more detail in subsequent disclosure.

The resulting calculation may be used to understand how many of theseindividual devices may be desired to produce a full resolution energysurface. In this case, approximately 105×105 or approximately 11,080devices may be desired to achieve the visual acuity threshold. Thechallenge and novelty exists within the fabrication of a seamless energysurface from these available energy locations for sufficient sensoryholographic propagation.

Summary of Seamless Energy Surfaces Configurations and Designs forArrays of Energy Relays

In some embodiments, approaches are disclosed to address the challengeof generating high energy location density from an array of individualdevices without seams due to the limitation of mechanical structure forthe devices. In an embodiment, an energy propagating relay system mayallow for an increase in the effective size of the active device area tomeet or exceed the mechanical dimensions to configure an array of relaysand form a singular seamless energy surface.

FIG. 3 illustrates an embodiment of such an energy relay system 300. Asshown, the relay system 300 may include a device 310 mounted to amechanical envelope 320, with an energy relay element 330 propagatingenergy from the device 310. The relay element 330 may be configured toprovide the ability to mitigate any gaps 340 that may be produced whenmultiple mechanical envelopes 320 of the device are placed into an arrayof multiple devices 310.

For example, if a device's active area 310 is 20 mm×10 mm and themechanical envelope 320 is 40 mm×20 mm, an energy relay element 330 maybe designed with a magnification of 2:1 to produce a tapered form thatis approximately 20 mm×10 mm on a minified end (arrow A) and 40 mm×20 mmon a magnified end (arrow B), providing the ability to align an array ofthese elements 330 together seamlessly without altering or collidingwith the mechanical envelope 320 of each device 310. Mechanically, therelay elements 330 may be bonded or fused together to align and polishensuring minimal seam gap 340 between devices 310. In one suchembodiment, it is possible to achieve a seam gap 340 smaller than thevisual acuity limit of the eye.

FIG. 4 illustrates an example of a base structure 400 having energyrelay elements 410 formed together and securely fastened to anadditional mechanical structure 430. The mechanical structure of theseamless energy surface 420 provides the ability to couple multipleenergy relay elements 410, 450 in series to the same base structurethrough bonding or other mechanical processes to mount relay elements410, 450. In some embodiments, each relay element 410 may be fused,bonded, adhered, pressure fit, aligned or otherwise attached together toform the resultant seamless energy surface 420. In some embodiments, adevice 480 may be mounted to the rear of the relay element 410 andaligned passively or actively to ensure appropriate energy locationalignment within the determined tolerance is maintained.

In an embodiment, the seamless energy surface comprises one or moreenergy locations and one or more energy relay element stacks comprise afirst and second side and each energy relay element stack is arranged toform a singular seamless display surface directing energy alongpropagation paths extending between one or more energy locations and theseamless display surface, and where the separation between the edges ofany two adjacent second sides of the terminal energy relay elements isless than the minimum perceptible contour as defined by the visualacuity of a human eye having better than 20/40 vision at a distancegreater than the width of the singular seamless display surface.

In an embodiment, each of the seamless energy surfaces comprise one ormore energy relay elements each with one or more structures forming afirst and second surface with a transverse and longitudinal orientation.The first relay surface has an area different than the second resultingin positive or negative magnification and configured with explicitsurface contours for both the first and second surfaces passing energythrough the second relay surface to substantially fill a +/−10-degreeangle with respect to the normal of the surface contour across theentire second relay surface.

In an embodiment, multiple energy domains may be configured within asingle energy relay, or between multiple energy relays to direct one ormore sensory holographic energy propagation paths including visual,acoustic, tactile or other energy domains.

In an embodiment, the seamless energy surface is configured with energyrelays that comprise two or more first sides for each second side toboth receive and emit one or more energy domains simultaneously toprovide bi-directional energy propagation throughout the system.

In an embodiment, the energy relays are provided as loose coherentelements.

Introduction to Component Engineered Structures Disclosed Advances inTransverse Anderson Localization Energy Relays

The properties of energy relays may be significantly optimized accordingto the principles disclosed herein for energy relay elements that induceTransverse Anderson Localization. Transverse Anderson Localization isthe propagation of a ray transported through a transversely disorderedbut longitudinally consistent material.

This implies that the effect of the materials that produce the AndersonLocalization phenomena may be less impacted by total internal reflectionthan by the randomization between multiple-scattering paths where waveinterference can completely limit the propagation in the transverseorientation while continuing in the longitudinal orientation.

Of significant additional benefit is the elimination of the cladding oftraditional multi-core optical fiber materials. The cladding is tofunctionally eliminate the scatter of energy between fibers, butsimultaneously act as a barrier to rays of energy thereby reducingtransmission by at least the core to clad ratio (e.g., a core to cladratio of 70:30 will transmit at best 70% of received energytransmission) and additionally forms a strong pixelated patterning inthe propagated energy.

FIG. 5A illustrates an end view of an example of one such non-AndersonLocalization energy relay 500, wherein an image is relayed throughmulti-core optical fibers where pixilation and fiber noise may beexhibited due to the intrinsic properties of the optical fibers. Withtraditional multi-mode and multi-core optical fibers, relayed images maybe intrinsically pixelated due to the properties of total internalreflection of the discrete array of cores where any cross-talk betweencores will reduce the modulation transfer function and increaseblurring. The resulting imagery produced with traditional multi-coreoptical fiber tends to have a residual fixed noise fiber pattern similarto those shown in FIG. 5A.

FIG. 5B, illustrates an example of the same relayed image 550 through anenergy relay comprising materials that exhibit the properties ofTransverse Anderson Localization, where the relayed pattern has agreater density grain structures as compared to the fixed fiber patternfrom FIG. 5A. In an embodiment, relays comprising randomized microscopiccomponent engineered structures induce Transverse Anderson Localizationand transport light more efficiently with higher propagation ofresolvable resolution than commercially available multi-mode glassoptical fibers.

In an embodiment, a relay element exhibiting Transverse AndersonLocalization may comprise a plurality of at least two differentcomponent engineered structures in each of three orthogonal planesarranged in a dimensional lattice and the plurality of structures formrandomized distributions of material wave propagation properties in atransverse plane within the dimensional lattice and channels of similarvalues of material wave propagation properties in a longitudinal planewithin the dimensional lattice, wherein energy waves propagating throughthe energy relay have higher transport efficiency in the longitudinalorientation versus the transverse orientation and are spatiallylocalized in the transverse orientation.

In an embodiment, a randomized distribution of material wave propagationproperties in a transverse plane within the dimensional lattice may leadto undesirable configurations due to the randomized nature of thedistribution. A randomized distribution of material wave propagationproperties may induce Anderson Localization of energy on average acrossthe entire transverse plane, however limited areas of similar materialwave propagation properties may form inadvertently as a result of theuncontrolled random distribution. For example, if the size of theselocal areas of similar wave propagation properties become too largerelative to their intended energy transport domain, there may be apotential reduction in the efficiency of energy transport through thematerial.

In an embodiment, a relay may be formed from a randomized distributionof component engineered structures to transport visible light of acertain wavelength range by inducing Transverse Anderson Localization ofthe light. However, due to their random distribution, the structures mayinadvertently arrange such that a continuous area of a single componentengineered structure forms across the transverse plane which is multipletimes larger than the wavelength of visible light. As a result, visiblelight propagating along the longitudinal axis of the large, continuous,single-material region may experience a lessened Transverse AndersonLocalization effect and may suffer degradation of transport efficiencythrough the relay.

In an embodiment, it may be desirable to design an ordered distributionof material wave propagation properties in the transverse plane of anenergy relay material. Such an ordered distribution would ideally inducean energy localization effect through methods similar to TransverseAnderson Localization, while minimizing potential reductions intransport efficiency due to abnormally distributed material propertiesinherently resulting from a random property distribution. Using anordered distribution of material wave propagation properties to induce atransverse energy localization effect similar to that of TransverseAnderson Localization in an energy relay element will hereafter bereferred to as Ordered Energy Localization.

In an embodiment, multiple energy domains may be configured within asingle, or between multiple Ordered Energy Localization energy relays todirect one or more sensory holographic energy propagation pathsincluding visual, acoustic, tactile or other energy domains.

In an embodiment, the seamless energy surface is configured with OrderedEnergy Localization energy relays that comprise two or more first sidesfor each second side to both receive and emit one or more energy domainssimultaneously to provide bi-directional energy propagation throughoutthe system.

In an embodiment, the Ordered Energy Localization energy relays areconfigured as loose coherent or flexible energy relay elements.

Considerations for 4D Plenoptic Functions Selective Propagation ofEnergy Through Holographic Waveguide Arrays

As discussed above and herein throughout, a light field display systemgenerally includes an energy source (e.g., illumination source) and aseamless energy surface configured with sufficient energy locationdensity as articulated in the above discussion. A plurality of relayelements may be used to relay energy from the energy devices to theseamless energy surface. Once energy has been delivered to the seamlessenergy surface with the requisite energy location density, the energycan be propagated in accordance with a 4D plenoptic function through adisclosed energy waveguide system. As will be appreciated by one ofordinary skill in the art, a 4D plenoptic function is well known in theart and will not be elaborated further herein.

The energy waveguide system selectively propagates energy through aplurality of energy locations along the seamless energy surfacerepresenting the spatial coordinate of the 4D plenoptic function with astructure configured to alter an angular direction of the energy wavespassing through representing the angular component of the 4D plenopticfunction, wherein the energy waves propagated may converge in space inaccordance with a plurality of propagation paths directed by the 4Dplenoptic function.

Reference is now made to FIG. 6 illustrating an example of light fieldenergy surface in 4D image space in accordance with a 4D plenopticfunction. The figure shows ray traces of an energy surface 600 to aviewer 620 in describing how the rays of energy converge in space 630from various positions within the viewing volume. As shown, eachwaveguide element 610 defines four dimensions of information describingenergy propagation 640 through the energy surface 600. Two spatialdimensions (herein referred to as x and y) are the physical plurality ofenergy locations that can be viewed in image space, and the angularcomponents theta and phi (herein referred to as u and v), which isviewed in virtual space when projected through the energy waveguidearray. In general, and in accordance with a 4D plenoptic function, theplurality of waveguides (e.g., lenslets) are able to direct an energylocation from the x, y dimension to a unique location in virtual space,along a direction defined by the u, v angular component, in forming theholographic or light field system described herein.

However, one skilled in the art will understand that a significantchallenge to light field and holographic display technologies arisesfrom uncontrolled propagation of energy due designs that have notaccurately accounted for any of diffraction, scatter, diffusion, angulardirection, calibration, focus, collimation, curvature, uniformity,element cross-talk, as well as a multitude of other parameters thatcontribute to decreased effective resolution as well as an inability toaccurately converge energy with sufficient fidelity.

In an embodiment, an approach to selective energy propagation foraddressing challenges associated with holographic display may includeenergy inhibiting elements and substantially filling waveguide apertureswith near-collimated energy into an environment defined by a 4Dplenoptic function.

In an embodiment, an array of energy waveguides may define a pluralityof energy propagation paths for each waveguide element configured toextend through and substantially fill the waveguide element's effectiveaperture in unique directions defined by a prescribed 4D function to aplurality of energy locations along a seamless energy surface inhibitedby one or more elements positioned to limit propagation of each energylocation to only pass through a single waveguide element.

In an embodiment, multiple energy domains may be configured within asingle, or between multiple energy waveguides to direct one or moresensory holographic energy propagations including visual, acoustic,tactile or other energy domains.

In an embodiment, the energy waveguides and seamless energy surface areconfigured to both receive and emit one or more energy domains toprovide bi-directional energy propagation throughout the system.

In an embodiment, the energy waveguides are configured to propagatenon-linear or non-regular distributions of energy, includingnon-transmitting void regions, leveraging digitally encoded,diffractive, refractive, reflective, grin, holographic, Fresnel, or thelike waveguide configurations for any seamless energy surfaceorientation including wall, table, floor, ceiling, room, or othergeometry based environments. In an additional embodiment, an energywaveguide element may be configured to produce various geometries thatprovide any surface profile and/or tabletop viewing allowing users toview holographic imagery from all around the energy surface in a360-degree configuration.

In an embodiment, the energy waveguide array elements may be reflectivesurfaces and the arrangement of the elements may be hexagonal, square,irregular, semi-regular, curved, non-planar, spherical, cylindrical,tilted regular, tilted irregular, spatially varying and/ormulti-layered.

For any component within the seamless energy surface, waveguide, orrelay components may include, but not limited to, optical fiber,silicon, glass, polymer, optical relays, diffractive, holographic,refractive, or reflective elements, optical face plates, energycombiners, beam splitters, prisms, polarization elements, spatial lightmodulators, active pixels, liquid crystal cells, transparent displays,or any similar materials exhibiting Anderson localization or totalinternal reflection.

Realizing the Holodeck Aggregation of Bi-Directional Seamless EnergySurface Systems to Stimulate Human Sensory Receptors within HolographicEnvironments

It is possible to construct large-scale environments of seamless energysurface systems by tiling, fusing, bonding, attaching, and/or stitchingmultiple seamless energy surfaces together forming arbitrary sizes,shapes, contours or form-factors including entire rooms. Each energysurface system may comprise an assembly having a base structure, energysurface, relays, waveguide, devices, and electronics, collectivelyconfigured for bi-directional holographic energy propagation, emission,reflection, or sensing.

In an embodiment, an environment of tiled seamless energy systems areaggregated to form large seamless planar or curved walls includinginstallations comprising up to all surfaces in a given environment, andconfigured as any combination of seamless, discontinuous planar,faceted, curved, cylindrical, spherical, geometric, or non-regulargeometries.

In an embodiment, aggregated tiles of planar surfaces form wall-sizedsystems for theatrical or venue-based holographic entertainment. In anembodiment, aggregated tiles of planar surfaces cover a room with fourto six walls including both ceiling and floor for cave-based holographicinstallations. In an embodiment, aggregated tiles of curved surfacesproduce a cylindrical seamless environment for immersive holographicinstallations. In an embodiment, aggregated tiles of seamless sphericalsurfaces form a holographic dome for immersive Holodeck-basedexperiences.

In an embodiment, aggregate tiles of seamless curved energy waveguidesprovide mechanical edges following the precise pattern along theboundary of energy inhibiting elements within the energy waveguidestructure to bond, align, or fuse the adjacent tiled mechanical edges ofthe adjacent waveguide surfaces, resulting in a modular and seamlessenergy waveguide system.

In a further embodiment of an aggregated tiled environment, energy ispropagated bi-directionally for multiple simultaneous energy domains. Inan additional embodiment, the energy surface provides the ability toboth display and capture simultaneously from the same energy surfacewith waveguides designed such that light field data may be projected byan illumination source through the waveguide and simultaneously receivedthrough the same energy surface. In an additional embodiment, additionaldepth sensing and active scanning technologies may be leveraged to allowfor the interaction between the energy propagation and the viewer incorrect world coordinates. In an additional embodiment, the energysurface and waveguide are operable to emit, reflect, or convergefrequencies to induce tactile sensation or volumetric haptic feedback.In some embodiments, any combination of bi-directional energypropagation and aggregated surfaces are possible.

In an embodiment, the system comprises an energy waveguide capable ofbi-directional emission and sensing of energy through the energy surfacewith one or more energy devices independently paired withtwo-or-more-path energy combiners to pair at least two energy devices tothe same portion of the seamless energy surface, or one or more energydevices are secured behind the energy surface, proximate to anadditional component secured to the base structure, or to a location infront and outside of the FOV of the waveguide for off-axis direct orreflective projection or sensing, and the resulting energy surfaceprovides for bi-directional transmission of energy allowing thewaveguide to converge energy, a first device to emit energy and a seconddevice to sense energy, and where the information is processed toperform computer vision related tasks including, but not limited to, 4Dplenoptic eye and retinal tracking or sensing of interference withinpropagated energy patterns, depth estimation, proximity, motiontracking, image, color, or sound formation, or other energy frequencyanalysis. In an additional embodiment, the tracked positions activelycalculate and modify positions of energy based upon the interferencebetween the bi-directional captured data and projection information.

In some embodiments, a plurality of combinations of three energy devicescomprising an ultrasonic sensor, a visible electromagnetic display, andan ultrasonic emitting device are configured together for each of threefirst relay surfaces propagating energy combined into a single secondenergy relay surface with each of the three first surfaces comprisingengineered properties specific to each device's energy domain, and twoengineered waveguide elements configured for ultrasonic andelectromagnetic energy respectively to provide the ability to direct andconverge each device's energy independently and substantially unaffectedby the other waveguide elements that are configured for a separateenergy domain.

In some embodiments, disclosed is a calibration procedure to enableefficient manufacturing to remove system artifacts and produce ageometric mapping of the resultant energy surface for use withencoding/decoding technologies as well as dedicated integrated systemsfor the conversion of data into calibrated information appropriate forenergy propagation based upon the calibrated configuration files.

In some embodiments, additional energy waveguides in series and one ormore energy devices may be integrated into a system to produce opaqueholographic pixels.

In some embodiments, additional waveguide elements may be integratedcomprising energy inhibiting elements, beam-splitters, prisms, activeparallax barriers or polarization technologies in order to providespatial and/or angular resolutions greater than the diameter of thewaveguide or for other super-resolution purposes.

In some embodiments, the disclosed energy system may also be configuredas a wearable bi-directional device, such as virtual reality (VR) oraugmented reality (AR). In other embodiments, the energy system mayinclude adjustment optical element(s) that cause the displayed orreceived energy to be focused proximate to a determined plane in spacefor a viewer. In some embodiments, the waveguide array may beincorporated to holographic head-mounted-display. In other embodiments,the system may include multiple optical paths to allow for the viewer tosee both the energy system and a real-world environment (e.g.,transparent holographic display). In these instances, the system may bepresented as near field in addition to other methods.

In some embodiments, the transmission of data comprises encodingprocesses with selectable or variable compression ratios that receive anarbitrary dataset of information and metadata; analyze said dataset andreceive or assign material properties, vectors, surface IDs, new pixeldata forming a more sparse dataset, and wherein the received data maycomprise: 2D, stereoscopic, multi-view, metadata, light field,holographic, geometry, vectors or vectorized metadata, and anencoder/decoder may provide the ability to convert the data in real-timeor offline comprising image processing for: 2D; 2D plus depth, metadataor other vectorized information; stereoscopic, stereoscopic plus depth,metadata or other vectorized information; multi-view; multi-view plusdepth, metadata or other vectorized information; holographic; or lightfield content; through depth estimation algorithms, with or withoutdepth metadata; and an inverse ray tracing methodology appropriatelymaps the resulting converted data produced by inverse ray tracing fromthe various 2D, stereoscopic, multi-view, volumetric, light field orholographic data into real world coordinates through a characterized 4Dplenoptic function. In these embodiments, the total data transmissiondesired may be multiple orders of magnitudes less transmittedinformation than the raw light field dataset.

System and Methods for Production of Ordered Energy Localization EnergyRelays

While the Anderson localization principle was introduced in the 1950s,it wasn't until recent technological breakthroughs in materials andprocesses that allowed the principle to be explored practically inoptical transport. Transverse Anderson localization is the propagationof a wave transported through a transversely disordered butlongitudinally invariant material without diffusion of the wave in thetransverse plane.

Within the prior art, Transverse Anderson localization has been observedthrough experimentation in which a fiber optic face plate is fabricatedthrough drawing millions of individual strands of fiber with differentrefractive index (RI) that were mixed randomly and fused together. Whenan input beam is scanned across one of the surfaces of the face plate,the output beam on the opposite surface follows the transverse positionof the input beam. Since Anderson localization exhibits in disorderedmediums an absence of diffusion of waves, some of the fundamentalphysics are different when compared to optical fiber relays. Thisimplies that the effect of the optical fibers that produce the Andersonlocalization phenomena are less impacted by total internal reflectionthan by the randomization of between multiple-scattering paths wherewave interference can completely limit the propagation in the transverseorientation while continuing in the longitudinal path. Further to thisconcept, it is introduced herein that an ordered distribution ofmaterial wave propagation properties may be used in place of arandomized distribution in the transverse plane of an energy transportdevice. Such an ordered distribution may induce Ordered EnergyLocalization in a transverse plane of the device while reducing theoccurrence of localized grouping of similar material properties, whichcan arise due to the nature of random distributions, and which maydegrade the overall efficacy of energy transport through the device.

In an embodiment, it may be possible for Ordered Energy Localizationmaterials to transport light as well as or better than, the highestquality commercially available multimode glass image fibers with ahigher MTF. With multimode and multicore optical fibers, the relayedimages are intrinsically pixelated due to the properties of totalinternal reflection of the discrete array of cores where any cross-talkbetween cores will reduce MTF and increase blurring. The resultingimagery produced with multicore optical fiber tends to have a residualfixed noise fiber pattern, as illustrated in FIG. 5A. By contrast, FIG.5B illustrates the same relayed image through an example material samplethat exhibits properties similar to that of the Transverse AndersonLocalization principle, referred to herein as Ordered EnergyLocalization, where the noise pattern appears much more like a grainstructure than a fixed fiber pattern.

Another advantage to optical relays that exhibit the Ordered Energylocalization phenomena is that it they can be fabricated from a polymermaterial, resulting in reduced cost and weight. A similar optical gradematerial generally made of glass or other similar materials may cost tento a hundred (or more) times more than the cost of the same dimension ofmaterial generated with polymers. Further, the weight of the polymerrelay optics can be 10-100× less given that up to a majority of thedensity of the material is air and other light weight plastics. For theavoidance of doubt, any material that exhibits the Anderson localizationproperty, or the Ordered Energy Localization property as describedherein, may be included in this disclosure herein, even if it does notmeet the above cost and weight suggestions. As one skilled in the artwill understand that the above suggestion is a single embodiment thatlends itself to significant commercial viabilities that similar glassproducts exclude. Of additional benefit is that for Ordered EnergyLocalization to work, optical fiber cladding may not be needed, whichfor traditional multicore fiber optics is required to prevent thescatter of light between fibers, but simultaneously blocks a portion ofthe rays of light and thus reduces transmission by at least the core toclad ratio (e.g. a core to clad ratio of 70:30 will transmit at best 70%of received illumination).

Another benefit is the ability to produce many smaller parts that can bebonded or fused without seams as the material fundamentally has no edgesin the traditional sense and the merger of any two pieces is nearly thesame as generating the component as a singular piece depending on theprocess to merge the two or more pieces together. For large scaleapplications, this is a significant benefit for the ability tomanufacturer without massive infrastructure or tooling costs, and itprovides the ability to generate single pieces of material that wouldotherwise be impossible with other methods. Traditional plastic opticalfibers have some of these benefits but due to the cladding, generallystill involve a seam line of some distances.

The present disclosure includes methods of manufacturing materialsexhibiting the Ordered Energy Localization phenomena. A process isproposed to construct relays of electromagnetic energy, acoustic energy,or other types of energy using building blocks that consist of one ormore component engineered structures (CES). The term CES refers to abuilding block component with specific engineered properties (EP) thatinclude, but are not limited to, material type, size, shape, refractiveindex, center-of-mass, charge, weight, absorption, magnetic moment,among other properties. The size scale of the CES may be on the order ofwavelength of the energy wave being relayed, and can vary across themilli-scale, the micro-scale, or the nano-scale. The other EP's are alsohighly dependent on the wavelength of the energy wave.

Within the scope of the present disclosure, a particular arrangement ofmultiple CES may form an ordered pattern, which may be repeated in thetransverse direction across a relay to effectively induce Ordered EnergyLocalization. A single instance of such an ordered pattern of CES isreferred to herein as a module. A module may comprise two or more CES. Agrouping of two or more modules within a relay is referred to herein asa cluster.

Ordered Energy Localization is a general wave phenomenon that applies tothe transport of electromagnetic waves, acoustic waves, quantum waves,energy waves, among others. The one or more building block structuresrequired to form an energy wave relay that exhibits Ordered EnergyLocalization each have a size that is on the order of the correspondingwavelength. Another critical parameter for the building blocks is thespeed of the energy wave in the materials used for those buildingblocks, which includes refractive index for electromagnetic waves, andacoustic impedance for acoustic waves. For example, the building blocksizes and refractive indices can vary to accommodate any frequency inthe electromagnetic spectrum, from X-rays to radio waves.

For this reason, discussions in this disclosure about optical relays canbe generalized to not only the full electromagnetic spectrum, but toacoustical energy and other types of energy. For this reason, the use ofthe terms energy source, energy surface, and energy relay will be usedoften, even if the discussion is focused on one particular form ofenergy such as the visible electromagnetic spectrum.

For the avoidance of doubt, the material quantities, process, types,refractive index, and the like are merely exemplary and any opticalmaterial that exhibits the Ordered Energy localization property isincluded herein. Further, any use of ordered materials and processes isincluded herein.

It should be noted that the principles of optical design noted in thisdisclosure apply generally to all forms of energy relays, and the designimplementations chosen for specific products, markets, form factors,mounting, etc. may or may not need to address these geometries but forthe purposes of simplicity, any approach disclosed is inclusive of allpotential energy relay materials.

In one embodiment, for the relay of visible electromagnetic energy, thesize of the CES should be on the order of 1 micron. The materials usedfor the CES can be any optical material that exhibits the opticalqualities desired to include, but not limited to, glass, plastic, resinand the like. The index of refraction of the materials are higher than1, and if two CES types are chosen, the difference in refractive indexbecomes a key design parameter. The aspect ratio of the material may bechosen to be elongated, in order to assist wave propagation in alongitudinal direction.

The formation of a CES may be completed as a destructive process thattakes formed materials and cuts the pieces into a desired shapedformation or any other method known in the art, or additive, where theCES may be grown, printed, formed, melted, or produced in any othermethod known in the art. Additive and destructive processes may becombined for further control over fabrication. These pieces are nowconstructed to a specified structure size and shape.

In one embodiment, for electromagnetic energy relays, it may be possibleto use optical grade bonding agents, epoxies, or other known opticalmaterials that may start as a liquid and form an optical grade solidstructure through various means including but not limited to UV, heat,time, among other processing parameters. In another embodiment, thebonding agent is not cured or is made of index matching oils forflexible applications. Bonding agent may be applied to solid structuresand non-curing oils or optical liquids. These materials may exhibitcertain refractive index (RI) properties. The bonding agent needs tomatch the RI of either CES material type 1 or CES material type 2. Inone embodiment, the RI of this optical bonding agent is 1.59, the sameas PS. In a second embodiment, the RI of this optical bonding agent is1.49, the same as PMMA.

In one embodiment, for energy waves, the bonding agent may be mixed intoa blend of CES material type 1 and CES material type 2 in order toeffectively cancel out the RI of the material that the bonding agent RImatches. The bonding agent may be thoroughly intermixed such that noregions are unsaturated which may require a certain amount of time forsaturation and desired viscous properties. Additional constant agitationmay be implemented to ensure the appropriate mixture of the materials tocounteract any separation that may occur due to various densities ofmaterials or other material properties.

It may be required to perform this process in a vacuum or in a chamberto evacuate any air bubbles that may form. An additional methodology maybe to introduce vibration during the curing process.

An alternate method provides for three or more CES with additional formcharacteristics and EPs.

In one embodiment, for electromagnetic energy relays, an additionalmethod provides for only a single CES to be used with only the bondingagent, where the RI of the CES and the bonding agent differ.

An additional method provides for any number of CESs and includes theintentional introduction of air bubbles.

In one embodiment, for electromagnetic energy relays, a method providesfor multiple bonding agents with independent desired RIs, and a processto intermix the zero, one, or more CES's as they cure either separatelyor together to allow for the formation of a completely intermixedstructure. Two or more separate curing methodologies may be leveraged toallow for the ability to cure and intermix at different intervals withdifferent tooling and procedural methodologies. In one embodiment, a UVcure epoxy with a RI of 1.49 is intermixed with a heat cure second epoxywith a RI of 1.59 where constant agitation of the materials isprovisioned with alternating heat and UV treatments with only sufficientduration to begin to see the formation of solid structures from withinthe larger mixture, but not long enough for any large particles to form,until such time that no agitation can be continued once the curingprocess has nearly completed, whereupon the curing processes areimplemented simultaneously to completely bond the materials together. Ina second embodiment, CES with a RI of 1.49 are added. In a thirdembodiment, CES with both a RI of 1.49 and 1.59 both added.

In another embodiment, for electromagnetic energy relays, glass andplastic materials are intermixed based upon their respective RIproperties.

In an additional embodiment, the cured mixture is formed in a mold andafter curing is cut and polished. In another embodiment, the materialsleveraged will re-liquefy with heat and are cured in a first shape andthen pulled into a second shape to include, but not limited to, tapersor bends.

FIG. 7A illustrates a cutaway view of a flexible implementation 70 of arelay exhibiting the Transverse Anderson Localization approach using CESmaterial type 1 (72) and CES material type 2 (74) with intermixing oilor liquid 76 and with the possible use of end cap relays 79 to relay theenergy waves from a first surface 77 to a second surface 77 on eitherend of the relay within a flexible tubing enclosure 78 in accordancewith one embodiment of the present disclosure. The CES material type 1(72) and CES material type 2 (74) both have the engineered property ofbeing elongated—in this embodiment, the shape is elliptical, but anyother elongated or engineered shape such as cylindrical or stranded isalso possible. The elongated shape allows for channels of minimumengineered property variation 75.

For an embodiment for visible electromagnetic energy relays,implementation 70 may have the bonding agent replaced with a refractiveindex matching oil 76 with a refractive index that matches CES materialtype 2 (74) and placed into the flexible tubing enclosure 78 to maintainflexibility of the mixture of CES material type 1 and CES material 2,and the end caps 79 would be solid optical relays to ensure that animage can be relayed from one surface of an end cap to the other. Theelongated shape of the CES materials allows channels of minimumrefractive index variation 75.

Multiple instances of 70 can be interlaced into a single surface inorder to form a relay combiner in solid or flexible form.

In one embodiment, for visible electromagnetic energy relays, severalinstances of 70 may each be connected on one end to a display deviceshowing only one of many specific tiles of an image, with the other endof the optical relay placed in a regular mosaic, arranged in such a wayto display the full image with no noticeable seams. Due to theproperties of the CES materials, it is additionally possible to fusemultiple the multiple optical relays within the mosaic together.

FIG. 7B illustrates a cutaway view of a rigid implementation 750 of aCES Transverse Anderson Localization energy relay. CES material type 1(72) and CES material type 2 (74) are intermixed with bonding agent 753which matches the index of refraction of material 2 (74). It is possibleto use optional relay end caps 79 to relay the energy wave from thefirst surface 77 to a second surface 77 within the enclosure 754. TheCES material type 1 (72) and CES material type 2 (74) both have theengineered property of being elongated—in this embodiment, the shape iselliptical, but any other elongated or engineered shape such ascylindrical or stranded is also possible. Also shown in FIG. 7B is apath of minimum engineered property variation 75 along the longitudinaldirection, which assists the energy wave propagation in this directionfrom one end cap surface 77 to the other end cap surface 77.

The initial configuration and alignment of the CESs can be done withmechanical placement, or by exploiting the EP of the materials,including but not limited to: electric charge, which when applied to acolloid of CESs in a liquid can result in colloidal crystal formation;magnetic moments which can help order CESs containing trace amounts offerromagnetic materials, or relative weight of the CESs used, which withgravity helps to create layers within the bonding liquid prior tocuring.

In one embodiment, for electromagnetic energy relays, the implementationdepicted in FIG. 7B would have the bonding agent 753 matching the indexof refraction of CES material type 2 (74), the optional end caps 79would be solid optical relays to ensure that an image can be relayedfrom one surface of an end cap to the other, and the critical EP withminimal longitudinal variation would be refractive index, creatingchannels 75 which would assist the propagation of localizedelectromagnetic waves.

In an embodiment for visible electromagnetic energy relays, FIG. 8illustrates a cutaway view in the transverse plane the inclusion of aDEMA (dimensional extra mural absorption) CES, 80, along with CESmaterial types 72, 74 in the longitudinal direction of one exemplarymaterial at a given percentage of the overall mixture of the material,which controls stray light, in accordance with one embodiment of thepresent disclosure for visible electromagnetic energy relays.

The additional CES materials that do not transmit light are added to themixture(s) to absorb random stray light, similar to EMA in traditionaloptical fiber technologies, only the absorbing materials are includedwithin a dimensional lattice and not contained within the longitudinaldimension, herein this material is called DEMA, 80. Leveraging thisapproach in the third dimension provides far more control than previousmethods of implementation where the stray light control is much morefully randomized than any other implementation that includes a strandedEMA that ultimately reduces overall light transmission by the percent ofthe area of the surface of all the optical relay components, whereas theDEMA is intermixed in the dimensional lattice that effectively controlsthe light transmission in the longitudinal direction without the samereduction of light in the transverse. The DEMA can be provided in anyratio of the overall mixture. In one embodiment, the DEMA is 1% of theoverall mixture of the material. In a second embodiment, the DEMA is 10%of the overall mixture of the material.

In an additional embodiment, the two or more materials are treated withheat and/or pressure to perform the bonding process and this may or maynot be completed with a mold or other similar forming process known inthe art. This may or may not be applied within a vacuum or a vibrationstage or the like to eliminate air bubbles during the melt process. Forexample, CES with material type PS and PMMA may be intermixed and thenplaced into an appropriate mold that is placed into a uniform heatdistribution environment capable of reaching the melting point of bothmaterials and cycled to and from the respective temperature withoutcausing damage/fractures due to exceeding the maximum heat elevation ordeclination per hour as dictated by the material properties.

For processes that require intermixing materials with additional liquidbonding agents, in consideration of the variable specific densities ofeach material, a process of constant rotation at a rate that preventsseparation of the materials may be required.

High Density Energy Directing Device

In an embodiment, an energy directing device may comprises one or moreenergy locations and one or more energy relay elements, each of the oneor more energy relay elements further comprising a first surface and asecond surface. The second surfaces of each energy relay element may bearranged to form a singular seamless energy surface.

In embodiments of the present disclosure, the one or more energylocations may comprise a display technology including any of:

-   -   a) LCD, LED, laser, CRT, OLED, AMOLED, TOLED, pico projector,        single chip, 3-chip, LCoS, DLP, Quantum Dots, monochrome, color,        projection, backlit, directly emissive, reflective, transparent,        opaque, coherent, incoherent, diffuse, direct, or any other        illumination source sufficient to produce the desired pixel        density; and    -   b) wherein any reflective display technology may be directly        bonded to the optical relay to provide an outdoor or ambient        illumination display, and further, combined with other materials        allows for the interaction of light with the relayed content for        both 2D and light field applications; and    -   c) a series of beamsplitters, prisms, or polarized elements and        arranging each of the above devices within the optical system to        provide a virtual energy surface that aggregates to include a        completely seamless integration of all of the active area        between the one or more devices even in consideration of the        mechanical envelopes; and    -   d) a series of parallel, converged, optically offset parallel        and converged, on-axis, off-axis, radial, aligned or otherwise        reflective or projection systems, each including a specified        resolution and mechanical envelope but projecting onto a surface        that is in aggregate smaller than the side-by-side footprint of        all of the one or more reflective or projection systems        combined.

In an embodiment, a separation between edges of any two adjacent secondsurfaces of the singular seamless energy surface may be less than aminimum perceptible contour as defined by the visual acuity of a humaneye having better than 20/40 vision at a distance, greater than thelesser of a height of the singular seamless energy surface or a width ofthe singular seamless energy surface, from the singular seamless energysurface.

Creating a seamless energy surface from a plurality of separateindependent energy sources presents a problem of significant seamsbetween the active areas of the energy sources.

For example, for visible electromagnetic energy, FIG. 9 represents anexample of the minimum separation possible between identical independentdisplays when mounted on flex cables. FIG. 9 illustrates a side view ofthree display devices 900, which each comprise an active display areadimension 902 and a mechanical envelope 906. Minimum gaps 908 highlightthe minimum possible space between any two active imaging surfaces 902of display devices 900. In the event that the active image to mechanicalenvelope ratio is less than 2:1 (e.g. the active area is 20 mm×10 mm andthe mechanical envelope is less than 40 mm×10 mm), it is possible to usebeam splitters or other similar optical and reflective materials tointerleave two image surfaces to form one single contiguous plane.

FIG. 10 is a side view illustration which describes one suchimplementation of this methodology. FIG. 10 features five displaydevices 100 which each comprise active display areas 1002 and mechanicalenvelopes 1004. Beam splitter 1006 combines image light 1008 produced bydisplay devices 1000 into a seamless image presentation 1010, whicheffectively masks the mechanical envelopes 1004 of the display devices1000. It should be noted that a highly non-reflective dark surface ispreferable at or near the display to mask out the non-image areas inorder to avoid reflection of the electronics and other non-displayregions.

FIG. 11 is a side view illustration of a second methodology where 3 beamsplitters are leveraged to accommodate a mechanical envelope that is a4:1 ratio. FIG. 11 features eight display devices 1100 which eachcomprise active display areas 1102 and mechanical envelopes 1104. Threebeam splitters 1106, 1108, and 1110 combine image light 1112 produced bythe eight display devices 1100 into a seamless image presentation 1114,which effectively masks the mechanical envelopes 1104 of the displaydevices 1100.

It should be noted that while these methods can work, the mechanicalaccuracy may preferably be near perfect to avoid incorrect angularviewing of each overlapping display plane and the overall viewedbrightness will decrease by the amount of light that is absorbed by thebeam splitter in order to redirect the rays of light to each discreetreflected plane. In FIG. 11, the brightness of image light 1112 willonly transmit at best 25% of actual display peak potential from displaydevices 1100 due to the loss of light from the overall system.Additionally, it should be noted that the size of the physical apparatuswith multiple reflections becomes quite large very quickly depending onthe size of the desired image surface.

It is also possible to consider projection technologies to aggregatemultiple images into a larger overall display, however, this comes atthe cost of great complexity for throw distance, minimum focus, opticalquality, thermal consistency considerations over a temperature gradientover time, as well as image blending, alignment, size and form factor.For most practical applications, hosting tens or hundreds of theseprojection sources results in a design that is much larger and lessreliable. With all of the above risks noted, all of the descriptionscontained herein may also apply to any form of projection technology inaddition to the disclosed panel methodologies.

An alternative methodology involves using many projectors in a tiledfashion to produce a seamless image surface in combination with a rearprojection surface. This surface may include screens, diffusers, andoptical relays in planar or non-planar surfaces. The regions betweeneach individually addressed tile should ideally overlap slightly andblend the transition between each tile appropriately, although notexplicitly required. The same concept of image area to mechanicalenvelope applies with some added complexity. We now introduce theconcepts of maximum optical offset along image surface position whichcan be controlled by moving the optics of the projection systemindependently from that of the image source resulting in a non-keystonedshift of the image to the energy surface. High quality optics aredesired for this to be successful and is often limited to less than thewidth of the projected image.

Additionally, when not using orthographic or collimated designs, we nowhave the challenge of minimum focus of the optics contained within theprojection system. This can be addressed by increasing the overallprojected image size per tile at the consequence of increasing theviewed distance to provide the desired pixel density as notated above.

FIG. 12 highlights this relationship between the mechanical enveloperatio, the minimum focus distance and the maximum image offset as wellas the percent of overlap between individual tiled images. FIG. 12illustrates a top view of an embodiment with three projection devices:one centered projection device 1200, and two off-centered projectiondevises 1201, 1203. The mechanical envelope of each projection device1200, 1201, 1203 creates a display offset which invites adjustment ofthe projection angle 1204 of each off-centered projection device 1201,1203. FIG. 12 highlights the use of off-axis projection optics, wherethe display panel 1214 is displaced from the optical axis of the displaylens 1216 by an amount 1202 in proportion to the display panel distancefrom the center of the array, allowing for the overlap of each of theseimages while maintaining a parallel array structure, and additionallyavoid a keystone image correction. Image light projected from theprojection devices 1200, 1201, 1203 forms a display image 1206 at imageplane 1208. Image light from off-centered projection device 1201, 1203will have an image offset 1210 and a fractional overlap 1212 at theimage plane 1208.

In an embodiment, the singular seamless energy surface may be planar,faceted, or curved. It is also possible to form an arc of projectors atthe expense of requiring keystone correction optically orcomputationally to form the singular energy surface. In an embodiment,three projection devices may be arranged in an arc. The projectiondevices may produce image light which propagates through a planar imageplane. The image light may experience keystone effects.

Alternatively, non-planar surfaces may be designed in order to placeeach projector directly behind the corresponding tile of viewed energysurface. FIG. 13 is a top view illustration of an embodiment with threeprojection devices 1300 arranged in an arc. The projection devices 1300produce image light 1302 which propagates through non-planar surface1304. Image light 1302 may experience keystone effects that theembodiment of FIG. 12 avoids. For both of these approaches, theprojectors do not necessarily need to be in a physically stackedconfiguration and may leverage reflectors or other optical methodologiesin order to provide application specific mechanical designs.

Any combination of these approaches may be employed where both beamsplitters and projection technologies can be leveraged simultaneously.

An additional embodiment of the system makes use of recent breakthroughsin energy relay technologies.

Tapered Energy Relays

In order to further solve the challenge of generating high resolutionfrom an array of individual energy wave sources containing extendedmechanical envelopes, the use of tapered energy relays can be employedto increase the effective size of each energy source. An array oftapered energy relays can be stitched together to form a singularcontiguous energy surface, circumventing the limitation of mechanicalrequirements for those energy sources.

In an embodiment, the one or more energy relay elements may beconfigured to direct energy along propagation paths which extend betweenthe one or more energy locations and the singular seamless energysurface.

For example, if an energy wave source's active area is 20 mm×10 mm andthe mechanical envelope is 40 mm×20 mm, a tapered energy relay may bedesigned with a magnification of 2:1 to produce a taper that is 20 mm×10mm (when cut) on the minified end and 40 mm×20 mm (when cut) on themagnified end, providing the ability to align an array of these taperstogether seamlessly without altering or violating the mechanicalenvelope of each energy wave source.

FIG. 14 illustrates an orthogonal view of one such tapered energy relaymosaic arrangement 1410, in accordance with one embodiment of thepresent disclosure. In FIG. 14, the relay device 1410 may include two ormore relay elements 1420, each relay element 1420 formed of one or morestructures, each relay element 1420 having a first surface 1440, asecond surface 1460, a transverse orientation (generally parallel to thesurfaces 1440, 1460) and a longitudinal orientation (generallyperpendicular to the surfaces 1440, 1410). The surface area of the firstsurface 1440 may be different than the surface area of the secondsurface 1460. For relay element 1420, the surface area of the firstsurface 1440 is less than the surface area of the second surface 1460.In another embodiment, the surface area of the first surface 1440 may bethe same or greater than the surface area of the second surface 1460.Energy waves can pass from the first surface 1440 to the second surface1460, or vice versa.

In FIG. 14, the relay element 1420 of the relay element device 1410includes a sloped profile portion 1480 between the first surface 1440and the second surface 1460. In operation, energy waves propagatingbetween the first surface 1440 and the second surface 1460 may havehigher transport efficiency in the longitudinal orientation than in thetransverse orientation, and energy waves passing through the relayelement 1420 may result in spatial magnification or spatialde-magnification. In other words, energy waves passing through the relayelement 1420 of the relay element device 1410 may experience increasedmagnification or decreased magnification. In an embodiment, energy maybe directed through the one or more energy relay elements with zeromagnification. In some embodiments, the one or more structures forforming relay element devices may include glass, carbon, optical fiber,optical film, plastic, polymer, or mixtures thereof.

In one embodiment, the energy waves passing through the first surfacehave a first resolution, while the energy waves passing through thesecond surface have a second resolution, and the second resolution is noless than about 50% of the first resolution. In another embodiment, theenergy waves, while having a uniform profile when presented to the firstsurface, may pass through the second surface radiating in everydirection with an energy density in the forward direction thatsubstantially fills a cone with an opening angle of +/−10 degreesrelative to the normal to the second surface, irrespective of locationon the second relay surface.

In some embodiments, the first surface may be configured to receiveenergy from an energy wave source, the energy wave source including amechanical envelope having a width different than the width of at leastone of the first surface and the second surface.

In an embodiment, energy may be transported between first and secondsurfaces which defines the longitudinal orientation, the first andsecond surfaces of each of the relays extends generally along atransverse orientation defined by the first and second directions, wherethe longitudinal orientation is substantially normal to the transverseorientation. In an embodiment, energy waves propagating through theplurality of relays have higher transport efficiency in the longitudinalorientation than in the transverse orientation and are spatiallylocalized in the transverse plane due to randomized refractive indexvariability in the transverse orientation coupled with minimalrefractive index variation in the longitudinal orientation via theprinciple of Transverse Anderson Localization. In some embodiments whereeach relay is constructed of multicore fiber, the energy wavespropagating within each relay element may travel in the longitudinalorientation determined by the alignment of fibers in this orientation.

Mechanically, these tapered energy relays are cut and polished to a highdegree of accuracy before being bonded or fused together in order toalign them and ensure that the smallest possible seam gap between therelays. The seamless surface formed by the second surfaces of energyrelays is polished after the relays are bonded. In one such embodiment,using an epoxy that is thermally matched to the taper material, it ispossible to achieve a maximum seam gap of 50 um. In another embodiment,a manufacturing process that places the taper array under compressionand/or heat provides the ability to fuse the elements together. Inanother embodiment, the use of plastic tapers can be more easilychemically fused or heat-treated to create the bond without additionalbonding. For the avoidance of doubt, any methodology may be used to bondthe array together, to explicitly include no bond other than gravityand/or force.

In an embodiment, a separation between the edges of any two adjacentsecond surfaces of the terminal energy relay elements may be less than aminimum perceptible contour as defined by the visual acuity of a humaneye having better than 20/40 vision at a distance from the seamlessenergy surface that is greater than the lesser of a height of thesingular seamless energy surface or a width of the singular seamlessenergy surface.

A mechanical structure may be preferable in order to hold the multiplecomponents in a fashion that meets a certain tolerance specification. Insome embodiments, the first and second surfaces of tapered relayelements can have any polygonal shapes including without limitationcircular, elliptical, oval, triangular, square, rectangle,parallelogram, trapezoidal, diamond, pentagon, hexagon, and so forth. Insome examples, for non-square tapers, such as rectangular tapers forexample, the relay elements may be rotated to have the minimum taperdimension parallel to the largest dimensions of the overall energysource. This approach allows for the optimization of the energy sourceto exhibit the lowest rejection of rays of light due to the acceptancecone of the magnified relay element as when viewed from center point ofthe energy source. For example, if the desired energy source size is 100mm by 60 mm and each tapered energy relay is 20 mm by 10 mm, the relayelements may be aligned and rotated such that an array of 3 by 10 taperenergy relay elements may be combined to produce the desired energysource size. Nothing here should suggest that an array with analternative configuration of an array of 6 by 5 matrix, among othercombinations, could not be utilized. The array comprising of a 3×10layout generally will perform better than the alternative 6×5 layout.

Energy Relay Element Stacks

While the most simplistic formation of an energy source system comprisesof an energy source bonded to a single tapered energy relay element,multiple relay elements may be coupled to form a single energy sourcemodule with increased quality or flexibility. One such embodimentincludes a first tapered energy relay with the minified end attached tothe energy source, and a second tapered energy relay connected to thefirst relay element, with the minified end of the second optical taperin contact with the magnified end of the first relay element, generatinga total magnification equal to the product of the two individual tapermagnifications. This is an example of an energy relay element stackcomprising of a sequence of two or more energy relay elements, with eachenergy relay element comprising a first side and a second side, thestack relaying energy from the first surface of the first element to thesecond surface of the last element in the sequence, also named theterminal surface. Each energy relay element may be configured to directenergy therethrough.

In an embodiment, an energy directing device comprises one or moreenergy locations and one or more energy relay element stacks. Eachenergy relay element stack comprises one or more energy relay elements,with each energy relay element comprising a first surface and a secondsurface. Each energy relay element may be configured to direct energytherethrough. In an embodiment, the second surfaces of terminal energyrelay elements of each energy relay element stack may be arranged toform a singular seamless display surface. In an embodiment, the one ormore energy relay element stacks may be configured to direct energyalong energy propagation paths which extend between the one or moreenergy locations and the singular seamless display surfaces.

FIG. 15 illustrates a side view of an energy relay element stack 1500consisting of two compound optical relay tapers 1522, 1524 in series,both tapers with minified ends facing an energy source surface 1526, inaccordance with an embodiment of the present disclosure. In FIG. 15, theinput numerical aperture (NA) is 1.0 for the input of taper 1524, butonly about 0.16 for the output of taper 1522. Notice that the outputnumerical aperture gets divided by the total magnification of 6, whichis the product of 2 for taper 1524, and 3 for taper 1522. One advantageof this approach is the ability to customize the first energy wave relayelement to account for various dimensions of energy source withoutalteration of the second energy wave relay element. It additionallyprovides the flexibility to alter the size of the output energy surfacewithout changing the design of the energy source or the first relayelement. Also shown in FIG. 15 is the energy source 1526 and themechanical envelope 1528 containing the energy source drive electronics.

In an embodiment, the first surface may be configured to receive energywaves from an energy source unit (e.g., 1526), the energy source unitincluding a mechanical envelope having a width different than the widthof at least one of the first surface and the second surface. In oneembodiment, the energy waves passing through the first surface may havea first resolution, while the energy waves passing through the secondsurface may have a second resolution, such that the second resolution isno less than about 50% of the first resolution. In another embodiment,the energy waves, while having a uniform profile when presented to thefirst surface, may pass through the second surface radiating in everydirection with an energy density in the forward direction thatsubstantially fills a cone with an opening angle of +/−10 degreesrelative to the normal to the second surface, irrespective of locationon the second relay surface.

In one embodiment, the plurality of energy relay elements in the stackedconfiguration may include a plurality of faceplates (relays with unitymagnification). In some embodiments, the plurality of faceplates mayhave different lengths or are loose coherent optical relays. In otherembodiments, the plurality of elements may have sloped profile portionssimilar to that of FIG. 14, where the sloped profile portions may beangled, linear, curved, tapered, faceted or aligned at anon-perpendicular angle relative to a normal axis of the relay element.In yet another embodiment, energy waves propagating through theplurality of relay elements have higher transport efficiency in thelongitudinal orientation than in the transverse orientation and arespatially localized in the transverse orientation due to randomizedrefractive index variability in the transverse orientation coupled withminimal refractive index variation in the longitudinal orientation. Inembodiments where each energy relay is constructed of multicore fiber,the energy waves propagating within each relay element may travel in thelongitudinal orientation determined by the alignment of fibers in thisorientation.

Energy Directing Device

FIG. 16 illustrates a perspective view of an embodiment 1600 of anenergy directing device where energy relay element stacks are arrangedin an 8×4 array to form a singular seamless energy directing surface1610 with the shortest dimension of the terminal surface of each taperedenergy relay element stack parallel to the longest dimension of theenergy surface 1610. The energy originates from 32 separate energysources 1650; each bonded or otherwise attached to the first element ofthe energy relay element stacks.

In an embodiment, a separation between the edges of any two adjacentsecond surfaces of the terminal energy relay elements may be less than aminimum perceptible contour as defined by the visual acuity of a humaneye having better than 20/100 vision at a distance, greater than thelesser of a height of the singular seamless display surface or a widthof the singular seamless display surface, from the singular seamlessdisplay surface.

FIG. 17 contains the following views of embodiment 1600: a front view1710, a top view 1710, a side view 1730, and a close-up side view 1740.

FIG. 18 is the close-up view of the side view 1740 of the energydirecting device 1600, consisting of a repeating structure comprised ofenergy relay element stacks 1830 arranged along a transverse orientationdefined by first and second directions, used to propagate energy wavesfrom the plurality of energy units 1850 to a single common seamlessenergy surface 1880 formed by the second surface of the energy relayelement stacks. Each energy unit 1850 is composed of an energy source1810 as well as the mechanical enclosure 1850 which houses the driveelectronics. Each relay stack is composed of a faceplate 1840 with nomagnification directly bonded to an energy source 1810 on one side, anda tapered energy relay on the other side, where the taper spatiallymagnifies the energy wave from the faceplate while propagating theenergy to the seamless energy surface 1880. In one embodiment, themagnification of the tapered energy relay is 2:1. In one embodiment,tapered energy relays 1820 are held in place by a common base structure1860, and each of these tapers are bonded to a faceplate 1840, which inturn is bonded to the energy unit 1850. Neighboring tapers 1820 arebonded or fused together at seam 1870 in order to ensure that thesmallest possible seam gap is realized. All the tapered energy relays inthe full 8×4 array are arranged in a seamless mosaic such that thesecond surface for each tapered energy relay forms a single contiguousenergy surface 1880, which is polished during assembly to ensureflatness. In one embodiment, surface 1810 is polished to within 10 wavesof flatness. Face plate 1885 has dimensions slightly larger than thedimensions of the surface 1880, and is placed in direct contact withsurface 1880 in order to extend the field of view of the tapered energysurface 1880. The second surface of the faceplate forms the outputenergy surface 1810 for the energy directing device 1800.

In this embodiment of 1800, energy is propagated from each energy source1810, through the relay stack 1830, and then substantially normal to thefaceplate, defining the longitudinal direction, the first and secondsurfaces of each of the relay stacks extends generally along atransverse orientation defined by the first and second directions, wherethe longitudinal orientation is substantially normal to the transverseorientation. In one embodiment, energy waves propagating through atleast one of the relay elements faceplate 1840, taper 1820, andfaceplate 1885, have higher transport efficiency in the longitudinalorientation than in the transverse orientation and are localized in thetransverse orientation due to randomized refractive index variability inthe transverse orientation coupled with minimal refractive indexvariation in the longitudinal orientation. In some embodiments at leastone of the relay elements faceplate 1840, taper 1820, and faceplate 1885may be constructed of multicore fiber, with energy waves propagatingwithin each relay element traveling in the longitudinal orientationdetermined by the alignment of fibers in this orientation.

In one embodiment, the energy waves passing through the first surface of181640 have a first spatial resolution, while the energy waves passingthrough the second surface of tapered energy relay 1820 and through theface plate have a second resolution, and the second resolution is noless than about 50% of the first resolution. In another embodiment, theenergy waves, while having a uniform profile at the first surface of thefaceplate 1840, may pass through the seamless energy surfaces 1880 and1810 radiating in every direction with an energy density in the forwarddirection that substantially fills a cone with an opening angle of +/−10degrees relative to the normal to the seamless energy surface 1810,irrespective of location on this surface 1810.

In an embodiment, an energy directing device comprises one or moreenergy sources and one or more energy relay element stacks.

In an embodiment, each energy relay element of an energy directingdevice may comprise at least one of:

-   -   1. one or more optical elements exhibiting transverse Anderson        Localization;    -   2. a plurality of optical fibers;    -   3. loose coherent optical fibers;    -   4. image combiners;    -   5. one or more gradient index optical elements;    -   6. one or more beam splitters;    -   7. one or more prisms;    -   8. one or more polarized optical elements;    -   9. one or more multiple size or length optical elements for        mechanical offset;    -   10. one or more waveguides;    -   11. one or more diffractive, refractive, reflective,        holographic, lithographic, or transmissive elements; and    -   12. one or more retroreflectors.

In an embodiment, a quantity of the one or more energy relay elementsand a quantity of the one or more energy locations may define amechanical dimension of the energy directing device. The quantity ofoptical relay elements incorporated into the system is unlimited andonly constrained by mechanical considerations and the resultant seamlessenergy surface includes a plurality of lower resolution energy sourcesproducing an infinite resolution energy surface only limited by theresolving power and image quality of the components included within thedisplay device.

A mechanical structure may be preferable in order to hold the multiplerelay components in a fashion that meets a certain tolerancespecification. Mechanically, the energy relays that contain a secondsurface that forms the seamless energy surface are cut and polished to ahigh degree of accuracy before being bonded or fused together in orderto align them and ensure that the smallest possible seam gap between theenergy relays is possible. The seamless surface 1880 is polished afterthe relays 1820 are bonded together. In one such embodiment, using anepoxy that is thermally matched to the tapered energy relay material, itis possible to achieve a maximum seam gap of 50 um. In anotherembodiment, a manufacturing process that places the taper array undercompression and/or heat provides the ability to fuse the elementstogether. In another embodiment, the use of plastic tapers can be moreeasily chemically fused or heat-treated to create the bond withoutadditional bonding. For the avoidance of doubt, any methodology may beused to bond the array together, to explicitly include no bond otherthan gravity and/or force.

The energy surface may be polished individually and/or as a singularenergy surface and may be any surface shape, including planar,spherical, cylindrical, conical, faceted, tiled, regular, non-regular,convex, concave, slanted, or any other geometric shape for a specifiedapplication. The optical elements may be mechanically mounted such thatthe optical axes are parallel, non-parallel and/or arranged with energysurface normal oriented in a specified way.

The ability to create various shapes outside of the active display areaprovides the ability to couple multiple optical elements in series tothe same base structure through clamping structures, bonding processes,or any other mechanical means desired to hold one or more relay elementsin place. The various shapes may be formed out of optical materials orbonded with additional appropriate materials. The mechanical structureleveraged to hold the resultant shape may be of the same form to fitover top of said structure. In one embodiment, an energy relay isdesigned with a square shape with a side that is equal to 10% of thetotal length of the energy relay, but 25% greater than the active areaof the energy source in width and height. This energy relay is clampedwith the matched mechanical structure and may leverage refractive indexmatching oil, refractive index matched epoxy, or the like. In the caseof electromagnetic energy sources, the process to place any two opticalelements in series may include mechanical or active alignment whereinvisual feedback is provided to ensure that the appropriate tolerance ofimage alignment is performed. Typically, a display is mounted to therear surface of the optical element prior to alignment, but this may ormay not be desired depending on application.

In an embodiment, the second sides of terminal energy relay elements ofeach energy relay element stack may be arranged to form a singularseamless energy surface.

In an embodiment, the singular seamless energy surface formed by amosaic of energy relay element stacks may be extended by placing afaceplate layer in direct contact with the surface, using a bondingagent, index matching oil, pressure, or gravity to adhere it to theenergy surface. In one embodiment, the faceplate layer may be composedof a single piece of energy relay material, while in others it iscomposed of two or more pieces of energy relay material bonded or fusedtogether. In one embodiment, the extension of a faceplate may increasethe angle of emission of the energy waves relative to the normal to theseamless energy surface.

In an embodiment, the one or more energy relay element stacks may beconfigured to direct energy along propagation paths which extend betweenthe one or more energy locations and the singular seamless energysurfaces.

In an embodiment, a separation between the edges of any two adjacentsecond surfaces of the terminal energy relay elements may be less than aminimum perceptible contour as defined by the visual acuity of a humaneye having better than 20/40 vision at a distance, greater than thelesser of a height of the singular seamless energy surface or a width ofthe singular seamless energy surface, from the singular seamless energysurface.

In an embodiment, the energy relay elements of each energy relay elementstack are arranged in an end-to-end configuration.

In an embodiment, energy may be directed through the one or more energyrelay element stacks with zero magnification, non-zero magnification, ornon-zero minification.

In an embodiment, any of the energy relay elements of the one or moreenergy relay element stacks may comprise an element exhibitingTransverse Anderson Localization, an optical fiber, a beam splitter, animage combiner, an element configured to alter an angular direction ofenergy passing therethrough, etc.

In an embodiment, energy directed along energy propagation paths may beelectromagnetic energy defined by a wavelength, the wavelength belongingto a regime of the electromagnetic spectrum such as visible light,ultraviolet, infrared, x-ray, etc. In an embodiment, energy directedalong energy propagation paths may be mechanical energy such as acousticsound, tactile pressure, etc. A volumetric sound environment is atechnology that effectively aspires to achieve holographic sound orsimilar technology. A dimensional tactile device produces an array oftransducers, air emitters, or the like to generate a sensation oftouching objects floating in midair that may be directly coupled to thevisuals displayed in a light field display. Any other technologies thatsupport interactive or immersive media may additionally be explored inconjunction with this holographic display. For the use of the energydirecting device as a display surface, the electronics may be mounteddirectly to the pins of the individual displays, attached to theelectronics with a socket such as a zero-insertion force (ZIF)connector, or by using an interposer and/or the like, to providesimplified installation and maintenance of the system. In oneembodiment, display electronic components including display boards,FPGAs, ASICs, IO devices or similarly desired components preferable forthe use of said display, may be mounted or tethered on flex orflexi-rigid cables in order to produce an offset between the displaymounting plane and the location of the physical electronic package.Additional mechanical structures are provided to mount the electronicsas desired for the device. This provides the ability to increase densityof the optical elements, thereby reducing the optical magnification forany tapered optical relays and decreasing overall display size and/orweight.

Cooling structures may be designed to maintain system performance withina specified temperature range, wherein all mechanical structures mayinclude additional copper or other similar material tubing to provide aliquid cooling system with a solid state liquid cooling system providingsufficient pressure on a thermostat regulator. Additional embodimentsmay include Peltier units or heat syncs and/or the like to maintainconsistent system performance for the electronics, displays and/or anyother components sensitive to temperature changes during operation orthat may produce excess heat.

FIG. 19 illustrates a top view of an embodiment 1900 where energy relayelement stacks composed of elements 1902 and 1903 are angled inward to aknown point in space 1904, directing energy to propagate from multiplesources 1908 through the seamless energy surface 1901. The basestructure 1906 directly supports the tapered energy relays 1902, whereeach taper is in turn bonded to relay 1903. For an embodiment where theenergy directing device 1900 is a display, tapered optical relayelements 1902 are angled inward to point the taper optical axes towardsa fixed point in space 1904. The energy sources 1908 comprise ofindividual displays, with display electronics contained with the displaymechanical envelope 1907.

In an embodiment, the optical relay may comprise loose coherent opticalrelays. Flexible optical elements, image conduits, and the like mayadditionally be leveraged in order to further offset display and displayelectronics from the seamless energy surface. In this fashion, it ispossible to form an optical relay bundle including multiple loosecoherent optical relays or other similar optical technology to connecttwo separate structures, with a first structure containing the seamlessenergy surface, and the second structure containing the display anddisplay electronics.

One or more additional optical elements may be mounted in front of, orbehind the ends of each loose coherent optical relay. These additionalelements may be mounted with epoxies, pressure, mechanical structures,or other methods known in the art.

FIG. 2000 is a top view illustration of an embodiment where the seamlessenergy surface 2002 is a display formed by tapered optical relays 2004,while the display devices 2006 and the mechanical envelopes for thedisplay electronics 2008 are located a distance away from the taperedrelays 2004. Relaying light from display devices 2006 to the taperedoptical relays 2004 are loose coherent optical relays 2010 each with endcaps 2012 at either end. Embodiment 2000 allows the display devices 2006to be disposed at the remote locations of 2008 away from the energysurface 2002 to ensure that a mechanical envelope of the display devices2006 does not interfere with the positioning of energy surface 2002.

Optical elements may exhibit differing lengths to provide offsetelectronics as desired when formed in an alternating structure andprovide the ability to increase density by the difference between thewidth of the electronic envelope minus the width of the optical element.In one such embodiment, a 5×5 optical relay mosaic contains twoalternating optical relay lengths. In another embodiment, a 5×5 opticalrelay mosaic may contain 5 different optical relay lengths producing apyramid-like structure, with the longest length at the center of thearray, producing higher overall density for the resultant optical relaymosaic.

FIG. 21 is a side view illustration of an embodiment 2100 wherein aseamless display surface 2108 is formed by nine tapered optical relays2102, each associated with a display device 2104 through an optical faceplate with one of five offset lengths 1, 2, 3, 4, or 5, such that no twoadjacent display devices 2104 are connected to a face plate with thesame offset length, providing sufficient clearance 2106 for respectivemechanical envelopes 2105 for the display electronics.

Selective Propagation of Energy in Light Field and Holographic WaveguideArrays

FIG. 22 illustrates a top-down perspective view of an embodiment of anenergy waveguide system 22100 operable to define a plurality of energypropagation paths 22108. Energy waveguide system 22100 comprises anarray of energy waveguides 22112 configured to direct energytherethrough along the plurality of energy propagation paths 22108. Inan embodiment, the plurality of energy propagation paths 108 extendthrough a plurality of energy locations 22118 on a first side of thearray 22116 to a second side of the array 22114.

Referring to FIG. 22 and FIG. 24A-H, in an embodiment, a first subset24290 of the plurality of energy propagation paths 22108 extend througha first energy location 22122. The first energy waveguide 22104 isconfigured to direct energy along a first energy propagation path 22120of the first subset 24290 of the plurality of energy propagation paths22108. The first energy propagation path 22120 may be defined by a firstchief ray 22138 formed between the first energy location 22122 and thefirst energy waveguide 22104. The first energy propagation path 22120may comprise rays 22138A and 22138B, formed between the first energylocation 22122 and the first energy waveguide 22104, which are directedby first energy waveguide 22104 along energy propagation paths 22120Aand 22120B, respectively. The first energy propagation path 22120 mayextend from the first energy waveguide 22104 towards the second side ofthe array 22114. In an embodiment, energy directed along the firstenergy propagation path 22120 comprises one or more energy propagationpaths between or including energy propagation paths 22120A and 22120B,which are directed through the first energy waveguide 22104 in adirection that is substantially parallel to the angle propagated throughthe second side 22114 by the first chief ray 22138.

Embodiments may be configured such that energy directed along the firstenergy propagation path 22120 may exit the first energy waveguide 22104in a direction that is substantially parallel to energy propagationpaths 22120A and 22120B and to the first chief ray 22138. It may beassumed that an energy propagation path extending through an energywaveguide element 22112 on the second side 22114 comprises a pluralityof energy propagation paths of a substantially similar propagationdirection.

FIG. 23 is a front view illustration of an embodiment of energywaveguide system 23000. The first energy propagation path 23120 mayextend towards the second side of the array in a unique direction 23208extending from the first energy waveguide 23104, which is determined atleast by the first energy location 23122. The first energy waveguide23104 may be defined by a spatial coordinate 23204, and the uniquedirection 23208 which is determined at least by first energy location23122 may be defined by an angular coordinate 23206 defining thedirections of the first energy propagation path 23120. The spatialcoordinate 23204 and the angular coordinate 23206 may form afour-dimensional plenoptic coordinate set 23210 which defines the uniquedirection 23208 of the first energy propagation path 23120.

Referring back to FIG. 22, in an embodiment, energy directed along thefirst energy propagation path 22120 through the first energy waveguide22104 substantially fills a first aperture 22134 of the first energywaveguide 22104, and propagates along one or more energy propagationpaths which lie between energy propagation paths 22120A and 22120B andare parallel to the direction of the first energy propagation path22120. In an embodiment, the one or more energy propagation paths thatsubstantially fill the first aperture 22134 may comprise greater than50% of the first aperture 22134 diameter.

In a preferred embodiment, energy directed along the first energypropagation path 22120 through the first energy waveguide 22104 whichsubstantially fills the first aperture 22134 may comprise between 50% to80% of the first aperture 22134 diameter. In embodiments, the firstenergy propagation path 22120 through the first energy waveguide 22104which substantially fills the first aperture 22134 may comprise adifferent degree of the first aperture 22134 diameter.

Turning again to FIGS. 22 and 24A-H, in an embodiment, the energywaveguide system 22100 may further comprise an energy inhibiting element22124 positioned to limit propagation of energy between the first side22116 and the second side 22114 and to inhibit energy propagationbetween adjacent waveguides 22112. In an embodiment, the energyinhibiting element is configured to inhibit energy propagation along aportion of the first subset 24290 of the plurality of energy propagationpaths 22108 that do not extend through the first aperture 22134. In anembodiment, the energy inhibiting element 22124 may be located on thefirst side 22116 between the array of energy waveguides 22112 and theplurality of energy locations 22118. In an embodiment, the energyinhibiting element 22124 may be located on the second side 22114 betweenthe plurality of energy locations 22118 and the energy propagation paths22108. In an embodiment, the energy inhibiting element 22124 may belocated on the first side 22116 or the second side 22114 orthogonal tothe array of energy waveguides 22112 or the plurality of energylocations 22118.

In an embodiment, energy directed along the first energy propagationpath 22120 may converge with energy directed along a second energypropagation path 22126 through a second energy waveguide 22128. Thefirst and second energy propagation paths may converge at a location22130 on the second side 22114 of the array 22112. In an embodiment, athird and fourth energy propagation paths 22140, 22141 may also convergeat a location 22132 on the first side 22116 of the array 22112. In anembodiment, a fifth and sixth energy propagation paths 22142, 22143 mayalso converge at a location 22136 between the first and second sides22116, 22114 of the array 22112.

In an embodiment, the energy waveguide system 22100 may comprisestructures for directing energy such as: a structure configured to alteran angular direction of energy passing therethrough, for example arefractive, diffractive, reflective, gradient index, holographic, orother optical element; a structure comprising at least one numericalaperture; a structure configured to redirect energy off at least oneinternal surface; an optical relay; etc. It is to be appreciated thatthe waveguides 22112 may include any one or combination of bidirectionalenergy directing structure or material, such as:

-   -   a) refraction, diffraction, or reflection;    -   b) single or compound multilayered elements;    -   c) holographic optical elements and digitally encoded optics;    -   d) 3D printed elements or lithographic masters or replicas;    -   e) Fresnel lenses, gratings, zone plates, binary optical        elements;    -   f) retro reflective elements;    -   g) fiber optics, total internal reflection or Anderson        Localization;    -   h) gradient index optics or various refractive index matching        materials;    -   i) glass, polymer, gas, solids, liquids;    -   j) acoustic waveguides;    -   k) micro & nano scale elements; or    -   l) polarization, prisms or beam splitters.

In an embodiment, the energy waveguide systems propagate energybidirectionally. In an embodiment, the energy waveguides are configuredfor propagation of mechanical energy. In an embodiment, the energywaveguides are configured for propagation of electromagnetic energy. Inan embodiment, by interlacing, layering, reflecting, combining, orotherwise provisioning the appropriate material properties within one ormore structures within an energy waveguide element, and within one ormore layers comprising an energy waveguide system, the energy waveguidesare configured for simultaneous propagation of mechanical,electromagnetic and/or other forms of energy.

In an embodiment, the energy waveguides propagate energy with differingratios for u and v respectively within a 4D coordinate system. In anembodiment, the energy waveguides propagate energy with an anamorphicfunction. In an embodiment, the energy waveguides comprise multipleelements along the energy propagation path. In an embodiment, the energywaveguides are directly formed from optical fiber relay polishedsurfaces. In an embodiment, the energy waveguide system comprisesmaterials exhibiting Transverse Anderson Localization. In an embodiment,the energy waveguide system propagates hypersonic frequencies toconverge tactile sensation in a volumetric space.

FIGS. 24A-H are illustrations of various embodiments of energyinhibiting element 22124. For the avoidance of doubt, these embodimentsare provided for exemplary purposes and in no way limiting to the scopeof the combinations or implementations provided within the scope of thisdisclosure.

FIG. 24A illustrates an embodiment of the plurality of energy locations24118 wherein an energy inhibiting element 24251 is placed adjacent tothe surface of the energy locations 24118 and comprises a specifiedrefractive, diffractive, reflective, or other energy altering property.The energy inhibiting element 24251 may be configured to limit the firstsubset of energy propagation paths 24290 to a smaller range ofpropagation paths 24253 by inhibiting propagation of energy along energypropagation paths 24252. In an embodiment, the energy inhibiting elementis an energy relay with a numerical aperture less than 1.

FIG. 24B illustrates an embodiment of the plurality of energy locations24118 wherein an energy inhibiting structure 24254 is placed orthogonalbetween regions of energy locations 24118, and wherein the energyinhibiting structure 24254 exhibits an absorptive property, and whereinthe inhibiting energy structure 24254 has a defined height along anenergy propagation path 24256 such that certain energy propagation paths24B255 are inhibited. In an embodiment, the energy inhibiting structure24254 is hexagonal in shape. In an embodiment, the energy inhibitingstructure 24254 is round in shape. In an embodiment, the energyinhibiting structure 24254 is non-uniform in shape or size along anyorientation of the propagation path. In an embodiment, the energyinhibiting structure 24254 is embedded within another structure withadditional properties.

FIG. 24C illustrates the plurality of energy locations 24118, wherein afirst energy inhibiting structure 24257 is configured to substantiallyorient energy 24259 propagating therethrough into a first state. Asecond energy inhibiting structure 24258 is configured to allow energy24259, which is substantially oriented in the first state, to propagatetherethrough, and to limit propagation of energy 24260 orientedsubstantially dissimilarly to the first state. In an embodiment, theenergy inhibiting element 24257, 24258 is an energy polarizing elementpair. In an embodiment, the energy inhibiting element 24257, 24258 is anenergy wave band pass element pair. In an embodiment, the energyinhibiting element 24257, 24258 is a diffractive waveguide pair.

FIG. 24D illustrates an embodiment of the plurality of energy locations24118, wherein an energy inhibiting element 24261 is structured to alterenergy propagation paths 24263 to a certain extent depending upon whichof the plurality of energy locations 24118 the energy propagation paths24263 extends through. Energy inhibiting element 24261 may alter energypropagation paths 24263 in a uniform or non-uniform way along energypropagation paths 24263 such that certain energy propagation paths 24262are inhibited. An energy inhibiting structure 24254 is placed orthogonalbetween regions of energy locations 24118, and wherein the energyinhibiting structure 24254 exhibits an absorptive property, and whereinthe inhibiting energy structure 24254 has a defined height along anenergy propagation path 24263 such that certain energy propagation paths24262 are inhibited. In an embodiment, an inhibiting element 24261 is afield lens. In an embodiment, an inhibiting element 24261 is adiffractive waveguide. In an embodiment, an inhibiting element 24261 isa curved waveguide surface.

FIG. 24E illustrates an embodiment of the plurality of energy locations24118, wherein an energy inhibiting element 24264 provides an absorptiveproperty to limit the propagation of energy 24266 while allowing otherpropagation paths 24267 to pass.

FIG. 24F illustrates an embodiment of the plurality of energy locations24118, and the plurality of energy waveguides 24112, wherein a firstenergy inhibiting structure 24268 is configured to substantially orientenergy 24270 propagating therethrough into a first state. A secondenergy inhibiting structure 24271 is configured to allow energy 24270,which is substantially oriented in the first state, to propagatetherethrough, and to limit propagation of energy 24269 orientedsubstantially dissimilarly to the first state. In order to furthercontrol energy propagation through a system, exemplified by the strayenergy propagation 24272, energy inhibiting structures 24268, 24271 mayrequire a compound energy inhibiting element to ensure energypropagation maintains accurate propagation paths.

FIG. 24G illustrates an embodiment of the plurality of energy locations24118, and wherein an energy inhibiting element 24276 provides anabsorptive property to limit the propagation of energy along energypropagation path 24278 while allowing other energy along energypropagation path 24277 to pass through a pair of energy waveguides 24112for an effective aperture 24284 within the array of waveguides 24112. Inan embodiment, energy inhibiting element 24276 comprises black chrome.In an embodiment, energy inhibiting element 24276 comprises anabsorptive material. In an embodiment, energy inhibiting element 24276comprises a transparent pixel array. In an embodiment, energy inhibitingelement 24276 comprises an anodized material.

FIG. 24H illustrates an embodiment comprising a plurality of energylocations 24118, and a plurality of energy waveguides 24112, wherein afirst energy inhibiting structure 24251 is placed adjacent to thesurface of the energy locations 24118 and comprises a specifiedrefractive, diffractive, reflective, or other energy altering property.The energy inhibiting structure 24251 may be configured to limit thefirst subset of energy propagation paths 24290 to a smaller range ofpropagation paths 24275 by inhibiting propagation of energy along energypropagation paths 24274. A second energy inhibiting structure 24261 isstructured to alter energy propagation paths 24275 to a certain extentdepending upon which of the plurality of energy locations 24118 theenergy propagation paths 24275 extend through. Energy inhibitingstructure 24261 may alter energy propagation paths 24275 in a uniform ornon-uniform way such that certain energy propagation paths 24274 areinhibited. A third energy inhibiting structure 24254 is placedorthogonal between regions of energy locations 24118. The energyinhibiting structure 24254 exhibits an absorptive property, and has adefined height along an energy propagation path 24275 such that certainenergy propagation paths 24274 are inhibited. An energy inhibitingelement 24276 provides an absorptive property to limit the propagationof energy 24280 while allowing energy 24281 to pass through. A compoundsystem of similar or dissimilar waveguide elements 24112 are positionedto substantially fill an effective waveguide element aperture 24285 withenergy from the plurality of energy locations 24118 and to alter thepropagation path 24273 of energy as defined by a particular system.

In an embodiment, the energy inhibiting element 24276 may comprise astructure for attenuating or modifying energy propagation paths. In anembodiment, the energy inhibiting element 24276 may include one or moreenergy absorbing elements or walls positioned within the system to limitpropagation of energy to or from the waveguides 24112. In an embodiment,the energy inhibiting element 24276 may include a specified numericalaperture, positioned within the system to limit the angular distributionof energy to and from waveguide 24112.

In an embodiment, the energy inhibiting element 24276 may include one ormore energy blocking walls, structures, metal, plastic, glass, epoxy,pigment, liquid, display technologies or other absorptive or structuralmaterial, with a determined thickness between a plane of energylocations 24122 and a waveguide array plane with voids or structuresthat are up to the pitch of a waveguide aperture diameter.

In an embodiment, the energy inhibiting structure 24254 is locatedproximate the first energy location 22122 and comprises an optical relayfaceplate adjacent to the first energy location 22122. In an embodiment,the energy inhibiting element 24276 may include an optical relayfaceplate comprising one or more spatially consistent or variablenumerical apertures, wherein the numerical aperture value meaningfullylimits the angular distribution of energy to and from the waveguide24112. For example, an embodiment of the numerical aperture may bedesigned to provide an angular distribution that is at or near two timesthe field of view formed between the energy location and perpendicularto the center of the effective waveguide element size, entrance pupil,aperture, or other physical parameter for energy propagation, to provideoff-axis fill factor for the specified waveguide aperture 24285.

In an embodiment, the energy inhibiting element 24276 may include abinary, gradient index, Fresnel, holographic optical element, zone plateor other diffractive optical element that alters the path of energywaves through the system to decrease scatter, diffusion, stray light, orchromatic aberration. In an embodiment, the energy inhibiting element24276 may include a positive or negative optical element at or aroundthe location wherein the energy propagation path is altered to furtherincrease the fill factor of the waveguide aperture 24285 or decreasestray light. In an embodiment, the energy inhibiting element 24276 mayinclude an active or passive polarized element combined with a secondactive or passive polarized element designed to provide spatial or timemultiplexed attenuation of defined regions of the energy location 22122,waveguide aperture 24285, or other regions. In an embodiment, the energyinhibiting element 24276 may include an active or passive aperture stopbarrier designed to provide spatial or time multiplexed attenuation ofdefined regions of the energy location 24122, waveguide aperture 24276or other regions. In an embodiment, the energy inhibiting element 24276many include any one the following or any combination thereof:

-   -   a) physical energy baffle structures;    -   b) volumetric, tapered or faceted mechanical structures;    -   c) aperture stops or masks;    -   d) optical relays and controlled numerical apertures;    -   e) refraction, diffraction, or reflection;    -   f) retro reflective elements;    -   g) single or compound multilayered elements;    -   h) holographic optical elements and digitally encoded optics;    -   i) 3D printed elements or lithographic masters or replicas;    -   j) Fresnel lenses, gratings, zone plates, binary optical        elements;    -   k) fiber optics, total internal reflection or Anderson        localization;    -   l) gradient index optics or various refractive index matching        materials;    -   m) glass, polymer, gas, solids, liquids;    -   n) milli, micro & nano scale elements; and    -   o) polarization, prisms or beam splitters

In an embodiment, the energy inhibiting structure 24254 may beconstructed to include hexagonally packed energy blocking bafflesconstructed to form voids that are tapered along the Z axis, decreasingin void size as the aperture stop location for the waveguide system isreached. In another embodiment, the energy inhibiting structure 24254may be constructed to include hexagonally packed energy blocking bafflesbonded to an optical relay face plate. In another embodiment, the energyinhibiting structure 24254 may be constructed to include hexagonallypacked energy blocking baffles filled with a prescribed refractive indexto further alter the path of energy wave projection to and from theenergy waveguide array. In another embodiment, a diffractive orrefractive element may be placed, attached or bonded to the energyblocking baffle with a defined waveguide prescription to further alterthe path of energy projection to and from the waveguide elements 24112.In another example, the energy inhibiting structure 24254 may be formedinto a single mechanical assembly, and the energy waveguide array 24254may be placed, attached or bonded to the assembled energy inhibitingelement 24254. It is to be appreciated that other implementations may beleveraged to enable other energy waveguide configurations orsuper-resolution considerations.

In an embodiment, the energy inhibiting structure 24254 may be locatedproximate the first energy location 22122 and generally extend towardsthe first energy waveguide 24104. In an embodiment, the energyinhibiting structure 24254 may be located proximate the first energywaveguide 24104 and generally extend towards the first energy location22122.

In an embodiment, the energy inhibiting elements are configured forinhibiting electromagnetic energy. In an embodiment, the energyinhibiting elements are configured for inhibiting mechanical energy. Inan embodiment, by interlacing, layering, reflecting, combining, orotherwise provisioning the appropriate material properties within one ormore structures within an energy inhibiting element, and within one ormore layers comprising an energy waveguide system, the energy inhibitingelements are configured for simultaneous attenuation of mechanical,electromagnetic and/or other forms of energy.

In an embodiment, an array of energy waveguides may be arranged to forma planar surface, or a curved surface of a desirable shape. FIG. 28 isan illustration of an embodiment 28100 featuring an array of energywaveguides 28102 arranged in a curved configuration.

Embodiments of the present disclosure may be configured to direct energyof any wavelength belonging to the electromagnetic spectrum, includingvisible light, ultraviolet, infrared, x-ray, etc. The present disclosuremay also be configured to direct other forms of energy such as acousticsound vibrations and tactile pressure waves.

FIG. 25 is an illustration of an additional embodiment of an energywaveguide system 25300. The energy waveguide system 25300 may define aplurality of energy propagation paths 25304, and may comprise areflector element 25314 comprising a first reflector 25306 located on afirst side 25310 of the reflector element 25314, the first reflector25306 comprising one or more aperture stops 25316 formed therethrough,and a second reflector 25308 located on a second side 25312 of thereflector element 25314, the second reflector 25308 comprising one ormore aperture stops 25318 formed therethrough. The first and secondreflectors 25306, 25308 are configured to direct energy along aplurality of energy propagation paths 25304 extending through theaperture stops of the first and second reflectors 25316, 25318 and aplurality of energy locations 25320 on the first side 25310 of thereflector element 25314. A first subset 25322 of the plurality of energypropagation paths 25304 extend through a first energy location 25324.The reflector element 25314 is configured to direct energy along a firstenergy propagation path 25326 of the first subset 25322 of the pluralityof energy propagation paths 25304.

In an embodiment, the first energy propagation path 25326 may be definedby a first chief ray 25338 formed between the first energy location25324 and a first aperture stop 25328 of the first reflector 25306. Thefirst energy propagation path 25326 may extend from a first aperturestop 25330 of the second reflector 25308 towards the second side 25312of the reflector element 25314 in a unique direction extending from thefirst aperture stop 25330 of the second reflector 25308, which isdetermined at least by the first energy location 25324.

In an embodiment, energy directed along the first energy propagationpath 25326 substantially fills the first aperture stop 25328 of thefirst reflector 25306 and the first aperture stop 25330 of the secondreflector 25308.

In an embodiment, an energy inhibiting element 25332 may be positionedto limit propagation of energy along a portion 25350 of the first subset25322 of the plurality of energy propagation paths 25304 that do notextend through the first aperture stop 25328 of the first reflector25306.

In an embodiment in which the energy is light and the energy waveguideis operable to direct said light, with a perfect parabolic structure,any ray that passes through, or from, the focus of the first reflectorwill reflect parallel to the optical axis, reflect off of the secondreflector, and then relay at the same angle in the inverse orientation.

In an embodiment, the first reflector and second reflector havediffering focal lengths, in order to produce varied magnification of theenergy information and/or to alter angular field of view coverage as aviewer from above the surface of the second reflector would view thereflected information. The aperture stops may be of differing sizes forvaried design purposes in collaboration with the varied focal lengths.

An additional embodiment is provided where both reflective surfaces areconical, faceted, curved in a non-linear shape or otherwise. The designof this curvature is critical to ensuring that the display informationand the viewed information may have a non-linear relationship to changeor simplify signal processing.

In an embodiment, the energy waveguides comprise flexible reflectivesurfaces capable of altering the reflective surface profile dynamicallyto change the propagation path of energy through the energy waveguidesystem.

In an embodiment, additional waveguides, including but not limited toreflective or optical elements, birefringent materials, liquid lenses,refractive, diffractive, holographic, or the like, may be locatedanywhere within the energy propagation path. With this approach, onesuch embodiment provides a design such that when viewed, the view anglesare at significantly different position than the aperture stop and focallength would have provided otherwise. FIG. 26 demonstrates one suchapplication of this approach.

FIG. 26 is an illustration of an embodiment of an energy waveguidesystem 26700. Energy waveguide system 26700 comprises first and secondreflectors 26702 and 26704, respectively. Positioned at the focus of thefirst reflector 26702 are additional optical elements 26706 and anenergy inhibitor 26707 perpendicular to the energy location 26708. Theadditional optical elements are designed to affect energy propagationpaths of energy propagating through energy waveguide system 26700.Additional waveguide elements may be included within the energywaveguide system 26700, or additional energy waveguide systems may beplaced into the energy propagation path.

In an embodiment, the array of energy waveguide elements may include:

-   -   a) A hexagonal packing of the array of energy waveguides;    -   b) A square packing of the array of energy waveguides;    -   c) An irregular or semi-regular packing of the array of energy        waveguides;    -   d) Curved or Non-planar array of energy waveguides;    -   e) Spherical array of energy waveguides;    -   f) Cylindrical array of energy waveguides;    -   g) Tilted regular array of energy waveguides;    -   h) Tilted irregular array of energy waveguides;    -   i) Spatially varying array of energy waveguides;    -   j) Multi-layered array of energy waveguides;

FIG. 27 highlights the differences between square packing 27901, hexpacking 27902 and irregular packing 27903 of an array of energywaveguide elements.

Several different geometries for CES particles and material pre-formshave been illustrated thus far. One important aspect of the presentdisclosure is that any arrangement or geometry of materials may beleveraged, so long as they abide by the criteria for ordereddistributions previously discussed. However, the pre-fused relaymaterial geometry may have a significant impact on the efficiency of thelocalization and energy propagation properties of the materials. Certaingeometries, known as convex uniform tilings, may provide advantageousdistributions of relay materials by arranging the materials in efficientconfigurations.

The Laves tilings have vertices at the centers of the regular polygons,and edges connecting centers of regular polygons that share an edge. Thetiles of the Laves tilings are called planigons including 3 regulartiles (triangle, square and pentagon) and 8 irregular ones. Each vertexhas edges evenly spaced around it. Three dimensional analogues of theplanigons are called stereohedrons.

All reflectional forms can be made by Wythoff constructions, representedby Wythoff symbols, or Coxeter-Dynkin diagrams, each operating upon oneof three Schwarz triangle (4,4,2), (6,3,2), or (3,3,3), with symmetryrepresented by Coxeter groups: [4,4], [6,3], or [3[3]]. Only one uniformtiling can't be constructed by a Wythoff process, but can be made by anelongation of the triangular tiling. An orthogonal mirror construction[∞,2,∞] also exists, seen as two sets of parallel mirrors making arectangular fundamental domain. If the domain is square, this symmetrycan be doubled by a diagonal mirror into the [4,4] family. We disclosewithin this provisional the geometries that may be leveraged.

A percolation model is to take a regular lattice, like a square lattice,and make it into a random network by randomly “occupying” sites(vertices) or bonds (edges) with a statistically independent probabilityp. At a critical threshold pc, large clusters and long-rangeconnectivity first appears, and this is called the percolationthreshold. Depending on the method for obtaining the random network, onedistinguishes between the site percolation threshold and the bondpercolation threshold. More general systems have several probabilitiesp1, p2, etc., and the transition is characterized by a critical surfaceor manifold. One can also consider continuum systems, such asoverlapping disks and spheres placed randomly, or the negative space.

When the occupation of a site or bond is completely random, this is theso-called Bernoulli percolation. For a continuum system, randomoccupancy corresponds to the points being placed by a Poisson process.Further variations involve correlated percolation, such as percolationclusters related to Ising and Potts models of ferromagnets, in which thebonds are put down by the Fortuin-Kasteleyn method. In bootstrap ork-sat percolation, sites and/or bonds are first occupied and thensuccessively culled from a system if a site does not have at least kneighbors. Another important model of percolation, in a differentuniversality class altogether, is directed percolation, whereconnectivity along a bond depends upon the direction of the flow.

Simply duality in two dimensions implies that all fully triangulatedlattices (e.g., the triangular, union jack, cross dual, martini dual andasanoha or 3-12 dual, and the Delaunay triangulation) all have sitethresholds of ½, and self-dual lattices (square, martini-B) have bondthresholds of ½.

Leveraging tiled structures may have the result of altering therespective holographic pixel aspect ratio, while providing variation infield of view spatially and/or volumetrically.

Reduction in moiré or repeating patterns may also provide increasedeffective resolution and simultaneously provides higher potential levelsof accuracy (increase in depth of field) by virtue of the variousconvergence locations that may be addressed. Increased efficiency ofresolution may also be achieved by packing more effective resolution inpotential dimensions that are more ideal for applications by notnecessarily leveraging a repeating single orientation or pattern.

Energy waveguides may be fabricated on a glass or plastic substrate tospecifically include optical relay elements if desirable and may bedesigned with glass or plastic optical elements to specifically includeoptical relays as well as desired. Furthermore, the energy waveguide maybe faceted for designs that provide multiple propagation paths or othercolumn/row or checkerboard orientations, specifically considering butnot limited to multiple propagation paths separated by beam-splitters orprisms, or tiled for waveguide configurations that allow for tiling, ora singular monolithic plate, or tiled in a curved arrangement (e.g.faceted cylinder or spherical with geometry alterations to the tiles tomate accordingly), curved surfaces to include but not limited tospherical and cylindrical or any other arbitrary geometry as requiredfor a specific application.

In an embodiment where the array of energy waveguides comprises a curvedconfiguration, the curved waveguide may be produced via heat treatmentsor by direct fabrication onto curved surfaces to include optical relayelements.

In an embodiment, the array of energy waveguides may abut otherwaveguides and may cover entire walls and/or ceilings and or roomsdepending on specific application. The waveguides may be designedexplicitly for substrate up or substrate down mounting. The waveguidemay be designed to mate directly to an energy surface or be offset withan air gap or other offset medium. The waveguide may include analignment apparatus to provide the ability to focus the plane activelyor passively either as a permanent fixture or a tooling element. Thepurposes of the geometries described is to help optimize the angle ofview defined by the normal of the waveguide element and the representedimagery. For a very large energy surface planar surface, the majority ofthe angular samples at the left and right-most of the surface are mainlyoutside of the viewing volume for an environment. For that same energysurface, with a curved contour and a curved waveguide, the ability touse more of these propagating rays to form the converging volume isincreased significantly. This is however at the expense of usableinformation when off-axis. The application specific nature of the designgenerally dictates which of the proposed designs will be implemented.Furthermore, a waveguide may be designed with regular, graduated, orregional element structures that are fabricated with an additionalwaveguide element to tilt the element towards a predetermined waveguideaxis.

In embodiments where the energy waveguides are lenses, the embodimentsmay include both convex and concave lenslets, and may include thefabrication of the lenses directly onto an optical relay surface. Thismay involve destructive or additive lenslet fabrication processes toinclude removal of material to form or stamp and lenslet profile, or thedirect replica fabricated directly to this surface.

An embodiment may include a multiple layered waveguide design thatprovides additional energy propagation optimizations and angularcontrol. All of the above embodiments may be combined togetherindependently or in conjunction with this approach. In an embodiment, amultiple layered design may be envisioned with tilted waveguidestructures on a first waveguide element and a regionally varyingstructure for a second waveguide element.

An embodiment includes the design and fabrication of a per element, orper region liquid lens waveguide joined together as a single waveguide.An additional design of this approach includes a single birefringent orliquid lens waveguide electrical cell that can modify an entirewaveguide array simultaneously. This design provides the ability todynamically control the effective waveguide parameters of the systemwithout redesigning the waveguide.

In an embodiment configured to direct light, with any combination of thedisclosures provided herein, it is possible to generate a wall mounted2D, light field or holographic display. The wall mounted configurationis designed such that a viewer is looking at an image that may float infront, at or behind of the designed display surface. With this approach,the angular distribution of rays may be uniform, or provided withincreased density at any particular placement in space depending onspecific display requirements. In this fashion, it is possible toconfigure the waveguides to alter angular distribution as a function ofsurface profile. For example, for a given distance perpendicular to thedisplay surface and a planar waveguide array, an optically perfectwaveguide would provide increased density at the perpendicular center ofthe display with a gradual increase in ray separation distance along agiven perpendicular distance to the display. Conversely, if viewing therays radially about the display where a viewer maintains a distancebetween the eyes and the center point of the display, the viewed rayswould maintain consistent density across the entire field of view.Depending on the anticipated viewing conditions, the properties of eachelement may be optimized by altering the waveguide functions to produceany potential distribution of rays to optimize the viewing experiencefor any such environment.

FIG. 29 is an illustration of an embodiment 29200 which highlights how asingle waveguide element function 29202 may produce identicaldistribution of energy 29204 across a radial viewing environment 29206,whereas the same waveguide element function 29202 when propagated at adistance 29208 that is constant and parallel to the waveguide surface29210 will appear to exhibit increased density at the waveguide elementcenter 29212 of the waveguide surface and decreased density further fromthe center 29212 of the waveguide surface.

FIG. 30 is an illustration of an embodiment 30300 which illustratesconfiguring the waveguide element functions 30302 to exhibit uniformdensity at a constant distance 30304 parallel to the waveguide surface30306 that simultaneously produces apparent lower density at the center30310 of the waveguide surface 30306 when measured about a radius 30308about the center of the waveguide surface 30306.

The ability to generate a waveguide function that varies samplingfrequency over field distance is a characteristic of various waveguidedistortions and known in the art. Traditionally, the inclusion ofdistortions are undesirable in a waveguide function, however, for thepurposes of waveguide element design, these are all characteristics thatare claimed as benefits to the ability to further control and distributethe propagation of energy depending on the specific viewing volumerequired. It may require the addition of multiple functions or layers ora gradient of functions across the entirety of the waveguide arraydepending on the viewing volume requirements.

In an embodiment, the functions are further optimized by curved surfacesof the energy surface and/or the waveguide array. The variation of thenormal of the chief ray angle in relation to the energy surface itselfmay further increase efficiency and require a different function than aplanar surface, although the gradient, variation and/or optimization ofthe waveguide function still applies.

Further, leveraging the resultant optimized waveguide array inconsideration of waveguide stitching methodologies, it is possible tofurther increase the effective size of the waveguide by tiling each ofthe waveguides and systems to produce any size or form-factor desired.It is important to note that the waveguide array may exhibit a seamartifact unlike the energy surface by virtue of reflections producedbetween any two separate substrates, the apparent contrast differentialat the mechanical seam, or due to any form of non-square grid packingschema. To counteract this effect, either a larger singular waveguidemay be produced, refractive matching materials may be leveraged betweenthe edges of any two surfaces, or regular waveguide grid structures maybe employed to ensure that no elements are split between two waveguidesurfaces, and/or precision cutting between energy inhibiting elementsand seaming along a non-square waveguide grid structure may beleveraged.

With this approach, it is possible to produce room scale 2D, light fieldand/or holographic displays. These displays may be seamless across largeplanar or curved walls, may be produced to cover all walls in a cubicfashion, or may be produced in a curved configuration where either acylindrical-type shape, or a spherical-type shape is formed to increaseview angle efficiency of the overall system.

Alternatively, it is possible to design a waveguide function that warpsthe propagated energy to virtually eliminate the region that is notdesired in the required angle of view resulting in a non-uniformdistribution of energy propagation. To accomplish this, one mayimplement a torus shaped optical profile, annular lens, concentric prismarray, a Fresnel or diffractive function, binary, refractive,holographic, and/or any other waveguide design may allow for a largeraperture and shorter focal length (herein will be referred to as a“Fresnel lenslet”) to provide the ability to practically form a singleor multi element (or multiple sheets) Fresnel waveguide array. This mayor may not be combined with additional optics, including an additionalwaveguide array, depending on waveguide configuration.

In order to produce wide energy propagation angles (e.g. 180 degrees) avery low effective f/number (e.g. <f/0.5) is required and in order toensure that no 4D “Disk Flipping” occurs (the ability for the ray fromone waveguide element to see undesired energy locations underneath ofany second waveguide element), it is further required that the focallength be appropriately matched closely to the angle of view required.This means that in order to produce a ˜160 degree viewing volume, an˜f/0.17 lens and a nearly matched ˜0.17 mm focal length is required.

FIG. 31 illustrates an embodiment 31400 wherein the plurality of energywaveguides comprise diffractive waveguide elements 31402, anddemonstrates one proposed structure for a modified Fresnel waveguideelement structure 31404 that produces an effectively extremely shortfocal length and low f/number while simultaneously directing rays ofenergy to explicitly defined locations 31406.

FIG. 32 illustrates an embodiment 32500 wherein the plurality of energywaveguides comprise elements 32502, and demonstrates how such awaveguide configuration 32506 may be used in an array to provide fulldensity of ray propagation for the desired viewing volume 32504.

A further embodiment of the proposed modified waveguide configurationprovides for a method to produce radially symmetric or spiraling ringsor gradient of two or more materials along either or both of atransverse or longitudinal orientation with a refractive index separatedby a predetermined amount with a per ring pitch with a diameter of X,where X may be constant or variable.

In a further embodiment, equal or non-linear distribution of all of therays are produced with or without the modified waveguide configurationsfor wall-mounted and/or table-mounted waveguide structures as well asall room or environment based waveguide structures where multiplewaveguides are tiled.

With a waveguide array, it is possible to produce planes of projectedlight that converge in space at a location that is not located at thesurface of the display itself. By ray-tracing these rays, one canclearly see the geometry involved and how converging rays may appearboth in-screen (away from the viewer) as well as off-screen (towardsviewer) or both simultaneously. As planes move away from the viewer onplanar displays with traditional waveguide array designs, the planestend to grow with the frustum of the viewpoint and may become occludedby the physical frame of the display itself depending on the number ofcontributing illumination sources. By contrast, as planes move towardthe viewer on planar displays with traditional waveguide array designs,the planes tend to shrink with the frustum of the viewpoint but areviewable from all angles at the specified location as long as the vieweris at an angle presenting energy to the eye and the virtual plane doesnot move beyond the angle created between the viewer and the far edge ofthe active display area.

In one embodiment, the viewed 2D image or images are presented off ofthe screen. In another embodiment, the viewed 2D image or images arepresented in screen. In another embodiment, the viewed 2D image orimages are presented simultaneously both in and/or off screen. Inanother embodiment, the viewed 2D image or images are presented incombination with other volumetric elements or presented as text forother graphic design or interactive reasons.

In another embodiment, the viewed 2D image or images are presented withhigher effective 2D resolution than the physical number of X and Ywaveguide elements would otherwise suggest due to the ability for raysto converge with higher density in space than physical elements.

The novelty of this approach is that it is entirely possible tomanufacture a holographic display that produces both volumetric imagingcapabilities, as well as extremely high resolution 2D imagery such thatthere is no further mechanical or electronic apparatus or alterationsnecessary to the waveguides in the display to move seamlessly betweenflat and volumetric imagery or produce other interesting effects.

With this property, it is possible to programmatically isolate certainillumination sources to present to a viewer that is only visible atexplicit angles to the display.

In one embodiment, a single pixel or group of pixels are illuminatedunder each waveguide element at an angle that triangulates to theviewer's eye and presents an image that is only viewable from thatviewer's position in space.

In another embodiment, a second illumination source or group ofillumination sources are presented simultaneously to triangulate to aposition that is only viewable by a second viewer and contains an imagethat may be the same or different than the first image presented to thefirst viewer. For the avoidance of doubt, this may be X addressableviewpoints where X represents the number of individually addressableviewpoints which may be one or more.

In another embodiment, these images are presented with eye, retinal,object or the like tracking leveraging sensors and algorithms known inthe art, to dynamically vary the illuminated pixel location to presentimagery dynamically to a triangulated location between the viewer andthe pixels under each waveguide element. This may be applied to one ormore viewers. The tracking may be performed as a 2D process or as a3D/stereoscopic process, or leveraging other depth sensing technologiesknown in the art.

In one embodiment, the first region and second region are both parabolicin profile, with the first region focus located at the apex of thesecond region and the second region focus located at the apex of thefirst region and the display surface located at an opening located atthe apex of the second region and an opening equivalent to the diameterof the display surface presented to the apex of the second regionlocated at the apex of the first region. With this approach, the displaysurface image will appear to float above a surface without any physicalsurfaces as the viewed rays that pass through the focus of the secondregion from an off-axis viewpoint will reflect off of the second regionsurface and parallel off of the first surface and then at the same anglefrom the viewed position in the inverse orientation from the firstregion to the display surface.

In an embodiment, a dual parabolic relay system that includes tworeflective regions each with a focus located at the apex of thealternate reflector, the display surface located at the apex of thesecond region, and an opening equivalent to the diameter of thepresented display surface located at the first region producing avirtual image of the display surface. In the event that a waveguidearray, holographic or light field display are leveraged, the viewedimagery will retain the nature of the holographic data as well asappearing to float in space without a physical display surface.

In another embodiment, the focus location of region two is differing toproduce magnification or minification. In a second embodiment, theregions have matched focal lengths and are offset by a distance greaterthan the focal length in order to produce a virtual image with increasedmagnification.

In another embodiment, the parabolic profiles are manufactured toaccommodate a specific shape that results in differing viewed positionsfrom the display to accommodate various display surface geometries orother required viewing angle or condition.

In another embodiment, the regions contain multiple facets in order toindependently propagate rays of light by facet region rather than as asingular surface.

In another embodiment, the reflective surface are formed of energyrelays such that the “Chief Ray Angle” CRA of the energy surface exceedsthe view angle possible from the curve applied to one or more surface(s)wherein the first surface that would have otherwise been a reflectivesurface has a certain geometric profile and the second surface at thealternate end of the waveguide element has a certain geometric profile,and cumulatively they have a CRA that reflects energy from a viewer'sposition and the addition of energy surface panels at the second surfacemay be implemented thereby providing energy information that is notviewable from the viewer's direct position but may provide energyinformation indirectly through one or more reflective surfaces and theassociated calibration process required to compute the reflected imagingdata in relation to the ultimately viewed data.

Configurations for Bi-Directional Seamless Energy Surfaces to PropagateTwo-Dimensional, Light Field and Holographic Energy

FIGS. 33A-33D illustrate four perspective views of tiling multipleenergy waveguide systems to form a seamless environment in differentshapes, in accordance with four embodiments of the present disclosure.FIG. 33A illustrates a perspective view of a large format aggregatedseamless energy surface 33910. FIG. 33B illustrates a perspective viewof a six-sided aggregated seamless surface environment 33920. FIG. 33Cillustrates a perspective view of a cylindrical aggregated energyenvironment 33930. FIG. 33D illustrates a perspective view of aspherical aggregated energy surface environment 33940 with a transparentplatform 33950 within.

Leveraging the resultant optimized energy system energy waveguide andsurface seaming processes, it is possible to further increase theeffective size of the system by tiling each of the energy surfaces andwaveguide elements to produce any size, shape, or form-factor desired.It is important to note that the waveguide element may exhibit a seamartifact by virtue of non-square grid waveguide element packing schema.To counter this effect, either a larger singular waveguide may beproduced, refractive matching materials may be leveraged between theedges of any two surfaces and cut to the angle required for a specifiedenvironment (e.g. systems placed at 90 degrees of each other may requirea 45 degree bezel cut for simplified bonding, although othermethodologies may be leveraged), and/or regular waveguide gridstructures may be employed to ensure that no waveguide elements aresplit between two waveguide surfaces. Further, it is possible toleverage non-square grid waveguide element structures and form a complexmechanical seam that follows the contour of the non-square grid patternand aligns to the light inhibiting elements within the waveguidestructures to provide a seam at the location of a non-energytransmitting location of the waveguide element.

FIG. 33E illustrates, in one embodiment, one such tiled curved waveguideand energy surface 33960 wherein the mechanical seam follows thestructure of the edge of the walls of the light inhibiting elementswithin the waveguide structures and leverages a bonding, mechanicalalignment, fusing, or the like process between the adjacent walls ofboth of the energy surfaces and waveguide surfaces to form the seamlessenergy waveguide system. As shown in the figure, the curved waveguideand energy surface 33960 includes four separate systems where waveguideseams can be seen prior to bonding, but may become seamless once bonded.It will be appreciated by one skilled in the art that there can be moreor fewer than four separate systems and that the energy surface can haveany sizes depending on application.

In an embodiment, a tiled array of seamless energy systems areconstructed to form a room scale 2D, light field and/or holographicdisplay. These displays may be seamless across large planar or curvedwalls, may be produced to cover all walls in a cubic fashion, or may beproduced in a curved configuration where either a cylindrical-typeshape, or a spherical-type shape is formed to increase view angleefficiency of the overall system. Nothing in this description shouldassume that it is not possible to directly construct a room sized devicedirectly, this embodiment is disclosed as a variation to fabricationmethodologies and to further expand the utilization of a single productline into larger devices through tiling, fusing, bonding, attaching,and/or stitching. Further, nothing in this description should beinterpreted to limit the room sizes, scales, shapes designs or any otherlimiting attribute to the ability to generate arbitrary tiled shapes togenerate a completely immersive energy environment.

As further embodiments of the above, the energy waveguide systems andthe energy relay systems may be assembled in any combination to formvarious aggregated seamless surfaces. For example, FIG. 33A illustratesa cinema/wall sized large screen planar seamless energy surface, FIG.33B illustrates a rectangular room with four walls and/or six surfacesto additionally comprise the ceiling and/or floor covered with planarand tiled seamless energy surfaces, FIG. 33C illustrates a tiled curvedsurface that produces a cylindrically shaped seamless environment, andFIG. 33D illustrates a spherical or dome environment designed from thecurved surfaces of each individual energy surfaces and tiled to form theseamless spherical environment.

In some embodiments, a plurality of energy waveguide systems and theenergy relay systems, similar to those discussed above, may be formedinto an aggregation system, where the plurality of energy systems areassembled to form a single planar or curved surface to create a seamlessaggregate surface oriented in a perpendicular configuration with respectto a floor surface, similar to the aggregated seamless energy surface33910 shown in FIG. 33A.

In other embodiments, a plurality of energy waveguide systems and theenergy relay systems, similar to those discussed above, may be formedinto an aggregation system, where the plurality of energy systems areassembled to form a single planar or curved surface to create a seamlessaggregate surface oriented in a parallel configuration with respect to afloor surface, similar to the transparent platform 33950 as shown inFIG. 33D.

In some embodiments, a plurality of energy waveguide systems and theenergy relay systems, similar to those discussed above, may be formedinto an aggregation system, where the plurality of energy systems areassembled to form two or more planar or curved surfaces to create aseamless aggregate surface across any combination of objects includingtables, walls, ceiling, floor or other surfaces.

In other embodiments, a plurality of energy waveguide systems and theenergy relay systems, similar to those discussed above, may be formedinto an aggregation system, where the plurality of energy systems areassembled to form three planar or curved surfaces to create a seamlessaggregate surface across three adjacent walls.

In some embodiments, a plurality of energy waveguide systems and theenergy relay systems, similar to those discussed above, may be formedinto an aggregation system, where the plurality of energy systems areassembled to form four planar or curved surfaces to create a seamlessaggregate surface across four enclosed walls.

In other embodiments, a plurality of energy waveguide systems and theenergy relay systems, similar to those discussed above, may be formedinto an aggregation system, where the plurality of energy systems areassembled to form five planar or curved surfaces to create a seamlessaggregate surface across any combination of objects including tables,walls, ceiling, floor or other surfaces.

In some embodiments, a plurality of energy waveguide systems and theenergy relay systems, similar to those discussed above, may be formedinto an aggregation system, where the plurality of energy systems areassembled to form six planar or curved surfaces to create a seamlessaggregate surface across four objects including tables, walls, ceiling,floor or other surfaces, in an enclosed environment, similar to theaggregated seamless energy surface 33920 shown in FIG. 33B.

In other embodiments, a plurality of energy waveguide systems and theenergy relay systems, similar to those discussed above, may be formedinto an aggregation system, where the plurality of energy systems areassembled to form a planar or curved surface to create a seamlessaggregate cylindrical surface across any range of angles, volumes andcombinations of objects including tables, walls, ceiling, floor or othersurfaces, similar to the aggregated seamless energy surface 33930 shownin FIG. 33C.

In some embodiments, a plurality of energy waveguide systems and theenergy relay systems, similar to those discussed above, may be formedinto an aggregation system, where the plurality of energy systems areassembled to form a planar or curved surface to create a seamlessaggregate spherical or domed surface across any range of angles, volumesand combinations of objects including tables, walls, ceiling, floor orother surfaces, similar to the aggregated seamless energy surface 33940shown in FIG. 33D.

As depicted in FIGS. 33A-33D, each system may further include anassembly of the systems having tiled, light field optomechanicalsystems, and each system may be configured for light field display andother bidirectional energy emission, reflection, or sensing. Each systemmay comprise a base structure, one or more components forming an energysurface, one or more elements forming a waveguide capable of alteringthe path of energy waves transmitted to or received from the energysurface, one or more energy devices emitting or receiving energy wavesto or from the energy surface, and one or more electronic components. Inan embodiment, the energy surface, the waveguide, the energy devices,and the electronic components are secured to the base structure. And inanother embodiment, the assembly is arbitrarily shaped to form aseamless, tiled optomechanical display.

In one embodiment, the energy relay system may further include relayelements including faceplates and optical tapers. In another embodiment,the array of energy waveguides may be bonded into a single waveguidecomponent. In some embodiments, the energy relay system may be alignedand calibrated to the singular seamless energy surface passively oractively with up to pixel-by-pixel rectification leveraging an externalcalibration tooling station or alignment hardware.

In one embodiment, the energy waveguide system may be mounted parallelto the base structure. In another embodiment, the singular seamlessenergy surface may be mounted orthogonal to the base structure.

In one embodiment, the one or more relay elements includes fused ortiled mosaics, where any seams between adjacent fused or tiled mosaicsare separated by or are less than the minimum perceptible contour asdefined by the visual acuity of a human eye having better than 20/40vision at a distance at or greater than the width or height of thesingular seamless energy surface.

In operation, the energy system may be configured to relay light to form2D, stereoscopic, multiview, plenoptic, 4D, volumetric, light field,holographic, or any other visual representation of light. In otherembodiments, the energy system may be operable to emit, reflect orconverge frequencies to induce tactile sensation or volumetric hapticfeedback.

In some embodiments, the array of energy waveguide is designed toproject rays up to 360 degrees along a horizontal axis with additionalrays in a vertical axis, and limiting rays perpendicular to the singularseamless energy surface. In other embodiments, the energy system isconfigured for a floor-mounted assembly or a ceiling-mounted assembly,and optionally includes a transparent surface above the floor-mountedassembly.

Reference is now made to FIG. 36, which is a further embodiment of FIG.33D, wherein an orthogonal view of a spherical structure 36120illustrates where viewers are surrounded by tiled and curved energysurfaces 36122 and are elevated above the bottom floor surface on atransparent platform 36124, in accordance with one embodiment of thepresent disclosure. FIG. 36 exemplifies the approach of decreasing angleof view requirements when placing a viewer within a central environmentvolume wherein a viewer or series of viewers exist within a range ofvolume (e.g., central viewing volume 36126) and demonstrates therelative angles of view required for each waveguide element for a givencentral viewing range (e.g., range of space that the viewers may movearound without loss of energy resolution).

A further embodiment of the above where equal or non-linear distributionof the rays are produced with or without Fresnel, diffractive, gradientindex, holographic optical element, digitally encoded or otherwisecustomized waveguide configurations for wall-mounted and/ortable-mounted energy waveguide structures as well as all room orenvironment based energy surface structures where multiple systems aretiled.

A further embodiment where a completely spherical or near-spherical orconical, cubic or other surrounding geometry, tiled energy structuresare produced and viewers walk on a transparent platform 36124 such thatthe energy surfaces 36122 are viewable in a radius surrounding theviewing volume 36126. In such a case, the rays propagate more normal tothe radial waveguide surface 36128 and leverage wall-mounted typewaveguide structures 36122 with distribution including perpendicularangles in relation to the normal of the curved surface in the requiredAOV.

FIG. 36 further illustrates spherical, conical and any non-planarenveloping surface where the viewing volume exists within a certainrelative energy focus position from the energy surfaces, resulting inthe possible optimization of a reduction of required angles of view fromeach respective waveguide. This phenomenon is produced by virtue of thenormal of the waveguide maintaining a much tighter relationship betweenthe viewer and the energy surface thus reducing the necessity forincreased angles of view that are traditionally required for planarsurfaces. FIG. 36 exemplifies this approach wherein a viewer or seriesof viewers exist within a range of volume and demonstrates the relativeangles of view required for each waveguide for a given central viewingrange (range of space that the viewers may move around without loss ofenergy propagation).

It is additionally possible to include multiple focus positions byaltering the waveguide prescription or by stacking multiple waveguidesor both to produce multiple regions of density along the z-axis whendirected to target specific regions in space for specific applications.It is additionally possible to layer multiple transmissive and/or onenon-transmissive and multiple transmissive energy surfaces wherein thewaveguide provides the ability to increase effective resolution throughvarious means of time sequential, spatial, or spatiotemporal superresolution, and may comprise two or more surfaces focused at differingpositions resulting in a change in propagation angle per energy surfaceand/or altering the physical location of the energy surface in relationto each other to produce angular dependencies in resultant energyvalues.

FIGS. 36, 33C and 33D additionally may include curved waveguidescommensurate with the curvature of the energy surface. The ability togenerate a waveguide function that varies sampling frequency over fielddistance is a characteristic of various distortions and known in theart. Traditionally, the inclusion of distortions are undesirable in awaveguide profile, however, for the purposes of curved waveguide elementdesign, these are all characteristics that further control anddistribute the rays of light depending on the specific viewingconditions desired. It may require the addition of multipleprescriptions, elements, layers or a gradient of prescriptions acrossthe entirety of the waveguide depending on the application andenvironment requirements.

An additional embodiment of the above where the prescriptions arefurther optimized by the curved surfaces of the energy surface and/orthe waveguide element. The variation of the normal of the chief rayangle (CRA) in relation to the energy surface itself may furtherincrease efficiency and require a different prescription than a planarwaveguide, although the gradient, variation and/or optimization of thewaveguide element still applies.

In a similar fashion as described for the variation of waveguideprescription to produce different energy ray densities depending ondistance and desired density as a function of spatial location, it isadditionally possible to further refine the prescription to generate ahorizontally viewable table-mounted waveguide.

Moving on to FIG. 34A illustrates a waveguide system 34400 having awaveguide element that exhibits a non-regular distribution of energydesigned to redistribute energy from a perpendicular orientation inrelation to waveguide surface to steeper angles throughout the element.In this embodiment, the plurality of energy waveguides may includediffractive waveguide elements 34402, and demonstrates one proposedstructure for a modified Fresnel waveguide element structure 34404 on aseamless energy surface 34408 that produces an effectively extremelyshort focal length and low f/number while simultaneously directing raysof energy to explicitly defined locations 34406. In another embodiment,the waveguide system 34400 includes non-regular waveguides 34410. Inoperation, there may be energy propagation within a first region 34420while there may be no energy propagation within a second region 34430.

FIG. 34B illustrates an orthogonal view of a table-mounted energysurface 34450 leveraging the waveguide elements from FIG. 34A, inaccordance with one embodiment of the present disclosure. FIG. 34Billustrates the variables to consider with a table-mounted energysurface to help articulate how it is possible to identify the specificsystem requirements. The considerations and goals for any such systemdesign are to produce an optimal distribution of energy for a givenenvironment.

For example, the energy surface 34450 may be oriented parallel to aground plane and for a given range of vertical and horizontal locations,configured to distribute energy with density appropriate for a desiredvertical and horizontal field of view 34455. In one embodiment, atable-mounted energy system requires the horizontal AOV to be 180degrees and the vertical to be 45 degrees. In a second embodiment, atable-mounted energy system requires the horizontal AOV to be 360degrees and the vertical to be 60 degrees. These embodiments arepresented for exemplary purposes only and in no way intended to limitthe scope of the numerous variations of system specifications that maybe designed.

As FIG. 34B illustrates, everything outside of the desired field of viewis un-utilized space. Taking the 360-degree example provided, while thefull 360 horizontal degrees require sufficient energy density, there arepotentially 30 degrees of vertical locations that are not required.While one may simply provide no energy to these regions in space, adesign with a waveguide function that provides information across180×180 degrees (when positioned perpendicular on a wall, 360 by 90degrees when placed parallel on a table), this is generally notefficient and results in energy densities that may not be practicalbased upon the target markets.

FIG. 34B illustrates an embodiment wherein the optomechanical assemblycomprises a waveguide exhibiting non-regular distribution of energyproviding 360 degrees in a horizontal axis and a limited distribution ina vertical axis with the energy surface parallel to a ground plane, byredirecting rays that would have otherwise been projected perpendicularto the energy surface. The assembly may be configured for afloor-mounted assembly or a ceiling-mounted assembly, and optionallyincludes a transparent platform above the floor-mounted assembly similarto those discussed above.

In one embodiment, the energy surface 34450 may include modifiedwaveguides having a viewing volume 34470 with a horizontal field of view34455. In this embodiment, the rays 34460 may be limited by the modifiedwaveguides on the energy surface 34450.

FIG. 34C illustrates an embodiment of the table-mounted waveguide systemof FIG. 34B comprising additional reflective waveguide elements havingan aperture to allow relayed converging energy from a first surface to asecond offset surface, and wherein the second surface is virtual. In oneembodiment, the system further includes a reflective waveguide elementhaving an aperture to relay converging energy from the singular seamlessenergy surface to virtual space.

In one embodiment, the waveguide system 34465 includes five energywaveguides 34470. Although five energy waveguides 34470 are shown, itwill be understood that there can be more or fewer waveguides. Theenergy waveguides 34470 may be coupled to a plurality of energy relays34474 to form a seamless energy surface 34476 in similar fashion asdescribed above. In one embodiment, the height 34472 of the energywaveguides 34470, the energy relays 34474 and the seamless energysurface 34476 may vary in relation to the object or focus as can beappreciated and understood by one of ordinary skill in the art.

In some embodiments, the table-mounted waveguide system 34465 mayinclude an additional reflective waveguide element 34490 having a firstreflector surface 34486 and a second reflector surface 34484. Thereflective waveguide element 34490 may include an aperture 34492 suchthat converging energy from the seamless energy surface 34476 may berelayed from the first reflector surface 34486 to the second reflectorsurface 34484 through the aperture 34492 to a viewer 34488. In otherwords, a first virtual object 34480 may be relayed and converged at avirtual space to form a second virtual object 34482.

As depicted in the various embodiments of this disclosure, anoptomechanical assembly may comprise energy relays inducing transverseAnderson localization and/or energy relays with two or more first orsecond surfaces for bidirectional propagation of energy.

FIG. 35 illustrates an orthogonal view of a floor-mounted tiled energysurface 35510 with a non-linear distribution of rays, in accordance withone embodiment of the present disclosure. FIG. 35 exemplifies thefloor-mounted tiled assembly 35510 with the non-linear distribution ofrays that tend to exclude the perpendicular rays to the energy surface.While it may be possible to configure the floor mounted tiled assembly35510 in the same waveguide structure as the other environment surfaceswhere perpendicular rays and off-axis rays are provided with even, orsome form of, distribution, however, with the proposed table mountedapproach placed at or approximate to the feet of a standing position (orabove or below depending on the requirements for the system), it ispossible to further optimize the waveguide configuration as no raysdirectly perpendicular to the floor assembly 35510 surface may need tobe represented as one will be self-occluding these rays with their bodyand/or feet. As shown in FIG. 35, in the event of a multiple viewerexperience, the perpendicular rays will not be viewable by otherparticipants as the rays presented in a perpendicular orientation,unlike walls or ceilings, are occluded or not at the correct view angleto produce artifacts. In other words, the floor assembly 35510 may beconfigured with modified waveguide elements 35520 such that certain raysmay not be visible due to self-occlusion 35530.

FIG. 37 illustrates an orthogonal view of a system 37130 of five viewerlocations 37132 and five corresponding energy locations 37134 under eachwaveguide element 37136 to present a single ray bundle to each viewerthat is unique to a single viewer location, in accordance with oneembodiment of the present disclosure. FIG. 37 illustrates five viewerlocations 37132A, 37132B, 37132C, 37132D, 37132E and five energylocations 37134A, 37134B, 37134C, 37134D, 37134E under each waveguideelement 37136 and an energy surface 37138. These ray bundles propagatedto the viewer locations are a direct result of the waveguide elementfunctions. In this fashion, all energy is propagated up tosimultaneously addressing each of the specified viewer locations withoutadditional knowledge of said locations. It is additionally possible toconfigure the energy system of FIG. 37 to include depth sensing devicesand algorithms known in the art to dynamically vary the energy locationinformation propagated to each of the specified viewer locations. Thismay be applied to one or more viewers. The tracking may be performed asa 2D process or as a 3D/stereoscopic process, or leveraging other depthsensing technologies known in the art. As will be appreciated by oneskilled in the art, because of the different viewer locations 37132 andthe different energy locations 37134, unique plurality of rays 37139 maybe provided to each viewer at his or her respective viewer locations45132.

FIG. 38A illustrates an energy relay combining element 38600 thatcomprises a first surface and two interwoven second surfaces 38630wherein the second surface 38630 having both an energy emitting device38610 and an energy sensing device 38620. A further embodiment of FIG.38A includes an energy relay structure 38640 having two or moresub-structure components 38610, 38620 for at least one of two or moresecond relay surfaces 38630, that exhibits different engineeredproperties between the sub-structure components of the two or moresecond relay surfaces 38630, including sub-structure diameter, whereinthe sub-structure diameter for each of the one or more second surfaces38630 is substantially similar to the wavelength for a determined energydevice and energy frequency domain.

FIG. 38B illustrates a further embodiment of FIG. 38A wherein the energywaveguide 38700 includes one or more element types 38710, 38720 withinone or more waveguide element surfaces 38730 and properties, where eachof the element types 38710, 38720 are designed to alter the propagationpath 38750, 38760 of a wavelength within the commensurate energyfrequency domain. In one embodiment, the energy waveguide 38700 mayinclude an electromagnetic energy emitting device 38710 and a mechanicalenergy emitting device 38720, each device 38710, 38720 configured toalter an electromagnetic energy relay path 38750 and a mechanical energyrelay path 38760, respectively.

In another embodiment, the wavelengths of any second energy frequencydomain may be substantially unaffected by the first energy frequencydomain. The combination of multiple energy devices on the two or moresecond surfaces of the energy relay and the one or more element typeswithin the one or more waveguide elements provides the ability tosubstantially propagate one or more energy domains through the energydevices, the energy relays, and the energy waveguides substantiallyindependently as required for a specified application.

In one embodiment, the energy waveguide 38700 may further include anelectromagnetic energy waveguide 38770 and a mechanical energy waveguide38780 assembled in a stacking configuration and coupled to asimultaneously integrated seamless energy surface 38730 similar to thatdescribed above. In operation, the energy waveguide 38700 is able topropagate energy paths such that all the energy is able to convergeabout a same location 38790.

In some embodiments, this waveguide 38700 may be a single relay elementwith a bidirectional energy surface, one interlaced segment to propagateenergy, and a second interlaced segment to receive energy at the energysurface. In this fashion, this may be repeated for every energy relaymodule in the system to produce a bidirectional energy surface.

FIG. 38C illustrates an orthogonal view of an implementation 38140 as afurther embodiment of FIG. 37 and comprises the energy relay of FIG. 38Awith a viewer at location L1 and time T1, with converging rays along apath through a waveguide and to energy coordinates P1, and where aviewer moves to location L2 at time T2, with rays converging along apath through a waveguide and to energy coordinates P2, and where each ofthe plurality of energy coordinates P1 and P2 are formed on a first sideof an energy relay surface and includes two interwoven second relaysurfaces and provides a first energy sensing device and a second energyemitting device to both sense movement and interaction within theviewing volume through the energy waveguide as well as emit energythrough the same energy relay and energy waveguide resulting in thevisible change to energy emitted from time and location T1, L1 to T2,L2, in accordance with one embodiment of the present disclosure.

In one embodiment, the system 38140 may include energy devices 38820where one set of energy devices are configured for energy emission 38810and another set of energy devices are configured for energy sensing38830. This embodiment may further include a plurality of relaycombining elements 38840 configured to provide a single seamless energysurface 38850. Optionally, a plurality of waveguides 38860 may bedisposed in front of the energy surface 38850. In operation, asdiscussed above, the system 38840 may provide simultaneousbi-directional energy sensing or emission with interactive control withthe propagated energy at T1 38870, and modified propagated energy at T238880, in response to sensed movement between T1, L1 and T2, L2.

Further embodiments of FIG. 38C include compound systems wherein theenergy relay system having more than two second surfaces, and whereinthe energy devices may be all of a differing energy domain, and whereineach of the energy devices may each receive or emit energy through afirst surface of the energy relay system.

FIG. 39 illustrates a further compound system 38140 of FIG. 38A(represented in FIG. 39 as 39140) with an orthogonal view of anembodiment where a viewer is at location L1 at time T1, with convergingrays along a path through a waveguide and to energy coordinates P1, andwherein a viewer moves to location L2 at time T2, with rays convergingalong a path through a waveguide and to energy coordinates P2, andwherein each of the plurality of energy coordinates P1 and P2 are formedon a first side of an energy relay surface and comprises three secondrelay surfaces having a first mechanical energy emitting device, asecond energy emitting device and a third energy sensing device, whereinthe energy waveguide emits both mechanical and energy through the firstsurface of the energy relay allowing the third energy sensing device todetect interference from the known emitted energy to the sensed receiveddata, and wherein the mechanical energy emission results in the abilityto directly interact with the emitted energy, the mechanical energyconverging to produce tactile sensation, the energy converging toproduce visible illumination, and the energy emitted at T1, L1 to T2, L2is modified to respond to the tactile interaction between the viewer andthe emitted energy, in accordance with one embodiment of the presentdisclosure.

In one embodiment, the system 38140 may include an ultrasonic energyemission device 39910, an electromagnetic energy emission device 39920,and an electromagnetic sensing device 39930. This embodiment may furtherinclude a plurality of relay combining elements 39940 configured toprovide a single seamless energy surface 39950. Optionally, a pluralityof waveguides 39970 may be disposed in front of the energy surface39950.

The one or more energy devices may be independently paired withtwo-or-more-path relay combiners, beam splitters, prisms, polarizers, orother energy combining methodology, to pair at least two energy devicesto the same portion of the energy surface. The one or more energydevices may be secured behind the energy surface, proximate to anadditional component secured to the base structure, or to a location infront and outside of the FOV of the waveguide for off-axis direct orreflective projection or sensing. The resulting energy surface providesfor bidirectional transmission of energy and the waveguide convergeenergy waves onto the energy device to sense relative depth, proximity,images, color, sound, and other energy, and wherein the sensed energy isprocessed to perform machine vision related tasks including, but notlimited to, 4D eye and retinal tracking through the waveguide array,energy surface and to the energy sensing device.

In operation, as discussed above, the system 39140 may providesimultaneous bi-directional energy sensing or emission with interactivecontrol with the propagated energy at T1 39960, propagated haptics at T139980, and modified propagated energy at T2 39990, in response to sensedinterference of propagated energy emission from sensed movement andultrasonic haptic response between T1, L1 and T2, L2.

FIG. 40 illustrates an embodiment of pairing one or more energy devices40010 to additional components (e.g., relay elements 40000 configured toform a single seamless energy surface 40020) where a viewer is atlocation L1, with converging rays along a path through a waveguide 40030and to energy coordinates P1, and where each of the plurality of energycoordinates P1 are formed on a first side of an energy relay surface40020 corresponding to one or more devices E1, and where the waveguideor relay surface provides an additional reflective or diffractiveproperty and propagated haptics 40060, where the reflective ordiffractive property substantially does not affect the propagation ofrays at coordinates P1.

In one embodiment, the reflective or diffractive property commensuratefor the energy of additional off-axis energy devices E2 40035A, 40035B,each of devices E2 40035A, 40035B containing an additional waveguide andenergy relay, each additional energy relay containing two or more secondsurfaces, each with a sensing or emitting device respectively withcorresponding energy coordinates P2 propagating through a similar volumeas P1. In one embodiment, reflective or diffractive energy can propagatethrough the devices of E2 40050.

In another embodiment, an additional system out of the field of view inrespect to the first E1 and second E2 waveguide elements comprise anadditional system E3 40040A, 40040B having additional waveguide andrelay elements, the relay elements having two second surfaces and onefirst surface, the second surfaces receiving energy from both focusedemitting and sensing energy devices.

In one embodiment, the E3 waveguide elements 40040A, 40040B areconfigured to propagate energy 40070 directly through a desired volume,the desired volume corresponding to the path of energy coordinates P1and P2, and forming additional energy coordinates P3 passing through theE3 system 40040A, 40040B, each of the E1, E2 and E3 sensing and emittingdevices configured to detect interference from the known emitted energyto the sensed received data.

In some embodiments, the mechanical energy emission results in theability to directly interact with the emitted energy, the mechanicalenergy converging to produce tactile sensation, the energy converging toproduce visible illumination, and the energy emitted is modified torespond to the tactile interaction between the viewer and the emittedenergy, in accordance with one embodiment of the present disclosure.

Various components within the architecture may be mounted in a number ofconfigurations to include, but not limit, wall mounting, table mounting,head mounting, curved surfaces, non-planar surfaces, or otherappropriate implementation of the technology.

FIGS. 38A, B, C, 39 and 40 illustrate an embodiment wherein the energysurface and the waveguide may be operable to emit, reflect, diffract orconverge frequencies to induce tactile sensation or volumetric hapticfeedback.

FIGS. 38A, B, C, 39 and 40 illustrates a bidirectional energy surfacecomprising (a) a base structure; (b) one or more components collectivelyforming an energy surface; (c) one or more energy devices; and (d) oneor more energy waveguides. The energy surface, devices, and waveguidesmay mount to the base structure and prescribe an energy waveguide systemcapable of bidirectional emission and sensing of energy through theenergy surface.

In an embodiment, the resulting energy display system provides for theability to both display and capture simultaneously from the sameemissive surface with waveguides designed such that light field data maybe projected by an illumination source through the waveguide andsimultaneously received through the same energy device surface withoutadditional external devices.

Further, the tracked positions may actively calculate and steer light tospecified coordinates to enable variable imagery and other projectedfrequencies to be guided to prescribed application requirements from thedirect coloration between the bidirectional surface image and projectioninformation.

In one embodiment of embodiment of FIGS. 38A, B, C, 39 and 40 the one ormore components are formed to accommodate any surface shape, includingplanar, spherical, cylindrical, conical, faceted, tiled, regular,non-regular, or any other geometric shape for a specified application.

In one embodiment of FIGS. 38A, B, C, 39 and 40 the one or morecomponents comprise materials that induce transverse Andersonlocalization.

In one embodiment, an energy system configured to direct energyaccording to a four-dimensional (4D) plenoptic function includes aplurality of energy devices; an energy relay system having one or moreenergy relay elements, where each of the one or more energy relayelements includes a first surface and a second surface, the secondsurface of the one or more energy relay elements being arranged to forma singular seamless energy surface of the energy relay system, and wherea first plurality of energy propagation paths extend from the energylocations in the plurality of energy devices through the singularseamless energy surface of the energy relay system. The energy systemfurther includes an energy waveguide system having an array of energywaveguides, where a second plurality of energy propagation paths extendfrom the singular seamless energy surface through the array of energywaveguides in directions determined by a 4D plenoptic function. In oneembodiment, the singular seamless energy surface is operable to bothprovide and receive energy therethrough.

In one embodiment, the energy system is configured to direct energyalong the second plurality of energy propagation paths through theenergy waveguide system to the singular seamless energy surface, and todirect energy along the first plurality of energy propagation paths fromthe singular seamless energy surface through the energy relay system tothe plurality of energy devices.

In another embodiment, the energy system is configured to direct energyalong the first plurality of energy propagation paths from the pluralityof energy devices through the energy relay system to the singularseamless energy surface, and to direct energy along the second pluralityof energy propagation paths from the singular seamless energy surfacethrough the energy waveguide system.

In some embodiments, the energy system is configured to sense relativedepth, proximity, images, color, sound and other electromagneticfrequencies, and where the sensed energy is processed to perform machinevision related to 4D eye and retinal tracking. In other embodiments, thesingular seamless energy surface is further operable to both display andcapture simultaneously from the singular seamless energy surface withthe energy waveguide system designed such that light field data may beprojected by the plurality of energy devices through the energywaveguide system and simultaneously received through the same singularseamless energy surface.

Vision Correction

Many people have less than perfect vision, and can have trouble seeingor focusing their vision on far-away objects or reading up-closelettering. A variety of conditions can negatively impact a person'sability to see, including, but not limited to farsightedness orhyperopia, nearsightedness or myopia, astigmatism, and presbyopia.Glasses were developed as a way to “correct” for a person's vision, byre-focusing the light entering a person's eyes to sharpen their view ofpreviously blurry or out-of-focus objects. Contact lenses employ thesame concept. Vision-correction surgery also operates along the sameprinciple of altering how light is focused on the photoreceptors in theback of our eyes.

Lenses used in glasses operate by bending light in a controlled andpredictable way. The lens equation is often used to describe arelationship useful for vision correction between three objects. It is1/(f)=1/(dO)+(1/dI), where f is the focal length of the lens, dO is thedistance from the lens to the object, and dI is the distance from thelens to the photo site. Using this equation, a corrective prescriptivefunction for contact lenses or eyeglasses can be determined that allowslight to be refocused into our eyes. In the present disclosure, wepropose that the same concept can be applied to a system utilizingholographic display technology according to the principles disclosedherein.

Vision correction may be achieved using holographic light field displaysystems. In the present disclosure, it is described how calibration andray tracing, as well as the 4D functions used herein, may be applied tovision correction.

Understanding how light field and 4D computational processing works, anovel implementation for a light field display not only createsholographic projections and content, but also provides the ability tocalibrate the projections and content for a specified viewer's eyesight.Vision-calibration parameters can also be stored as a display profile insome embodiments to allow every single viewer to experience in-focus,optically correct images leveraging a high fidelity light field displayutilizing appropriate calibration sequences—as disclosed herein—andappropriate processing algorithms.

In addition to holographic imaging, these concepts can also be leveragedfor 2D mediums in some embodiments so that any image viewed on a displaythat is 4D enabled may also provide for the dioptric correctionsrequired for a user's vision—all without a visit to the optometrist, andwithout prescription eyewear.

The proposed system provides at least for the following within thedisclosure:

-   -   a 4D light field display system    -   an interactive control system capable of providing an eye exam        from a 4D display for one or more users and storing the results        in a data storage system for later use    -   a calibration system that leverages the results from the vision        tests    -   a processor capable of reading the vision results and the        calibration files on a storage device and processing the results        in real time or offline to provide individualized optical        corrections    -   a methodology for eye/retinal tracking to provide visual        corrections for two or more separate eye profiles, or more than        a single user at a time    -   a user interface to dynamically switch between various detected        or manually input users    -   a method to switch between 4D and 2D modes

Some embodiments of the 4D display system of this disclosure can performthe calibration process for individual user or, even for each eye of theindividual users.

In some embodiments, the process goes through a series of:

-   -   object positions at x diopters + or − the display surface (and        at the display surface);    -   object focus for each of the previous object positions at each        step location, increasing or decreasing the number of diopters        used within the calculation for the projection of the object        (e.g., to normal vision, will get out of focus in front and        behind of the focus point);    -   other vision related calibrations may be included for color        variation, eye to eye variation, etc.

For each position within the vision calibration sequence, in someembodiments, the viewer will indicate if the results are better orworse, much like a traditional eye exam. The results from thecalibration process will be individually prepared and rendered for thatviewer to correct for any visual anomalies without the requirement forthe viewer to get prescription glasses. This provides the viewer theability to update the calibration of a display anytime the viewer feelsthe need. Further, this may apply to all content, not just holographiccontent. This may also be leveraged as a security setting on a display,as when initiated, images will appear blurry or out of focus to otherindividuals looking at the display.

FIG. 41 illustrates a system 41000 for correcting vision in anearsighted viewer. An eye of the viewer is represented at 41006. Nearthe back of the eye, original image rays 41003 converge at an incorrectlocation 41001, which causes the viewer to see an incorrect image.Through use of a device having a 4D virtual pixel plane 41005 and avirtual display which, in some embodiments may include a plane ofprojection waveguides 41006, it is possible to create a corrected groupof rays leveraging calibration results at 41004. Corrected rays 41004can be seen converging at the correct location 41002 on the back surfaceof eye 41006, resulting in the viewer seeing an “in focus” image.

FIG. 42 illustrates a system 42000 for correcting vision in a farsightedviewer. An eye of the viewer is represented at 42006. Image rays 42003converge at an incorrect location behind the back surface of the eye420006 due to incorrect focus 42001. This produces a distorted image forthe viewer. Through use of a device having a 4D virtual pixel plane42005 and a virtual plane of projection waveguides 42006, it is possibleto create a corrected group of rays leveraging calibration results at42004. Corrected rays 42004 can be seen converging at the correctlocation 42002 on the back surface of eye 42006, resulting in the viewerseeing an “in focus” image.

FIG. 43 illustrates a comparison between the perceived images seen byviewers with uncorrected nearsightedness 43001, uncorrectedfarsightedness 43002, and with a 4D correction applied, or a person withcorrect vision at 43003.

FIG. 44 depicts one embodiment of a vision-corrective device 44100 ofthis disclosure. However, the vision-corrective device 44100 disclosedherein is not limited to the one depicted in FIG. 44, and there areother possible embodiments. As shown in FIG. 44, the vision-correctiondevice 44100 includes a light-directing system 44102. Thelight-directing system 44102 may include any light-directing system ofthis disclosure or others known in the art. Some embodiments of avision-corrective device include a light-source system 44113. In anembodiment the light-source system 44113 may include a plurality oflight sources. In an embodiment the light sources may provide lightenergy to one or more light locations 44108. In an embodiment the lightlocations 44108 are located at the same location as the light sources.In an embodiment, one or more light locations 44108 may be located atthe surface of the light sources. In some embodiments, the light-sourcesystem 44113 may further include a relay system like that depicted inFIG. 3 for guiding energy from an energy source 310 through the relay tothe plurality of light locations on a surface 350 of the relay. As willbe appreciated, the light-source system may include other relays inother embodiments including but not limited to the relays depicted inFIGS. 3-5, 7A, 7B, 14-16, 20-21, and 38A-C. Other relays known in theart may also be used in certain embodiments.

Different embodiments may employ different light sources, or differentcombinations of light sources. Any energy source described elsewhere inthis disclosure may be used in different embodiments as well as otherenergy sources known in the art. Some examples include, but are notlimited to LCD, LED, laser, CRT, OLED, AMOLED, TOLED, pico projector,single chip, 3-chip, LCoS, DLP, Quantum Dots, monochrome, color,projection, backlit, directly emissive, reflective, transparent, opaque,coherent, incoherent, diffuse, direct, or any other illumination sourcesufficient to produce the desired pixel density as discussed elsewherein this disclosure.

In an embodiment, the light-directing system 44102 may include an arrayof waveguides 44104. Different embodiments may have different waveguidestructures including the waveguides of this disclosure; however, otherembodiments may not utilize waveguides 44104 as a component of thelight-directing system 44102. A person of ordinary skill in the art willappreciate that there are also alternative embodiments that areconsistent with the disclosures made herein that may utilize alternativelight-directing systems.

FIG. 44 depicts an embodiment where light emitted by the plurality oflight sources is directed by the array of waveguides 44104 along aplurality of light propagation paths 44106. FIG. 44 is for demonstrativepurposes only and does not limit the embodiments disclosed herein. And,additional light propagation paths may be present in additionalembodiments as depicted and discussed elsewhere in this disclosure.

One side of each of the propagation paths 44106 extends through one of aplurality of light locations 44108 in the embodiment depicted in FIG.44. A first waveguide 44110 of the array of waveguides 44104 may beconfigured to direct light from a first light location 44112 of theplurality of light locations 44108 along a first propagation path 44114of the plurality of propagation paths 44106. The first propagation path44114 extends from the first waveguide 44110 in a unique direction. Inother words, the first propagation path is the only propagation paththat extends from the first waveguide 44110 in that direction. Theunique direction of the first propagation path 44114 is determined atleast by the first light location 44112. But, it should be appreciatedthat in some embodiments there may be additional, or other, factors thatdetermine the unique direction. Different types of waveguides 44104 maybe utilized in different embodiments. Some embodiment may also combinedifferent types of waveguides. And, this embodiment of thevision-correction device may be combined with the other embodiments ofthis disclosure unless explicitly stated otherwise including but notlimited to the waveguide structures depicted in FIGS. 23-26 and 28-32.

Some embodiments will also include a second waveguide 44116 of the arrayof waveguides 44104 that is configured to direct light from a secondlight location 44118 of the plurality of light locations 44108 along asecond propagation path 44120 of the plurality of propagation paths44108. The second propagation path 44120 extends from the secondwaveguide 44116 in a second unique direction. Similar to therelationship between the first propagation path 44114 and the firstwaveguide 44110, the second propagation path 44120 is the onlypropagation path that extends from the second waveguide 44116 in thatdirection. The second unique direction of the second propagation path44120 is determined at least by the second light location 44118. And, asmentioned above, in some embodiments there may be additional, or other,factors that may determine the unique direction. A person of ordinaryskill in the art will also recognize that some embodiments will alsohave additional waveguides and propagation paths that extend from awaveguide in a unique direction that is determined at least by a lightlocation. These unique directions provide a means to identify andindependently control the propagation paths that extend from thewaveguides helping to allow the vision-correction device to make thekinds of specific adjustments needed to tailor the device for anindividual user, or in some embodiments, multiple users.

In an embodiment, the vision-corrective device 44100 depicted in FIG. 44includes a control system 44122. The control system 44122 is configuredto operate the plurality of light sources to direct light through thelight-directing system 44102 to project a first holographic object 44124along the plurality of propagation paths 44106 according to afour-dimensional (“4D”) light field function. The 4D light fieldfunction is determined to account for an uncorrected visual acuity of afirst user. Some embodiments may also include a processor, which isdiscussed elsewhere in this disclosure. Other embodiments may alsoinclude a memory, which is discussed elsewhere in this disclosure.

In some embodiments, the unique direction can be determined at least bya first light location 44112. Some embodiments allow the first waveguide44110 to define a two-dimensional (2D) spatial coordinate wherein theunique direction determined at least by the first light location 44112includes a two-dimensional (2D) angular coordinate, and whereby the 2Dspatial coordinate and the 2D angular coordinate form a 4D light fieldcoordinate set. Energy waveguide systems allowing these types ofembodiments have been discussed previously in this disclosure using atleast FIGS. 22-26 and 28-32 as non-limiting demonstrative illustrations.Some embodiments of the light-directing system 44100 of FIG. 44 includean energy waveguide system 44102 that allows 2D spatial coordinate andthe 2D angular coordinate form a 4D light field coordinate set asillustrated in FIG. 23.

In an embodiment, light directed along the first propagation path 44114through the first waveguide 44110 substantially fills a first aperture44128 of the first waveguide 44110. In an embodiment, the waveguides ofthe vision-correction device 44100 may include different waveguidesincluding but not limited to those discussed in reference to FIGS.22-32. Some embodiments may also employ more than one waveguide. Otherembodiments may use other waveguide structures known in the art incombination with waveguides of this disclosure, or instead of thewaveguides of this disclosure.

In an embodiment, the light-directing system 44102 includes a firstlight-inhibiting element 44130 positioned to limit propagation of lightalong a portion of the plurality of propagation paths that do not extendthrough the first aperture 44128. In an embodiment, the firstlight-inhibiting element 44130 includes a baffle structure forattenuating or modifying the portion of propagation paths that do notextend through the first aperture. In an embodiment, the firstlight-inhibiting element 44130 may include any kind of light-inhibitingelement referenced in this disclosure or known in the art.

In an embodiment, light directed along the second propagation path 44120through the second waveguide 44116 substantially fills a second aperture44132 of the second waveguide 44116. Furthermore, as mentioned above, indifferent embodiments, the waveguides of the vision-correction device,including the first, second, and any additional waveguides, may includethe different waveguides of this disclosure including but not limited tothose discussed in reference to FIGS. 24-26 and 28-32. Some embodimentsmay also employ more than one waveguide of this disclosure. Otherembodiments may use other waveguide structures known in the art incombination with waveguides of this disclosure, or instead of thewaveguides of this disclosure.

In an embodiment, the light-directing system 44102 includes a secondlight-inhibiting element 44134 positioned to limit propagation of lightalong a portion of the plurality of propagation paths that do not extendthrough the second aperture 44132. In an embodiment, the secondlight-inhibiting element 44134 includes a baffle structure forattenuating or modifying the portion of propagation paths that do notextend through the second aperture 44132. In some embodiments, thesecond light-inhibiting element 44134 may include any kind oflight-inhibiting element referenced in this disclosure or known in theart.

In some embodiments, additional propagation paths extending fromwaveguides in unique directions may also substantially fill additionalapertures of the additional waveguides. The additional waveguides mayalso include additional light-inhibiting elements positioned to limitpropagation of light along a portion of propagation paths that do notextend through any aperture, and may include baffles in some instances.However, the light-inhibiting elements may also include any of the otherlight-inhibiting elements referenced in this disclosure. Unlessexplicitly stated otherwise, embodiments of the vision-correction deviceincluding waveguides, apertures, light-inhibiting elements, and baffles,may be combined with the other embodiments of this disclosure. In anembodiment, light directed along the first propagation path 44114 mayconverge with light directed along the second propagation path 44120.Additional propagation paths extending in unique directions fromadditional waveguides may also converge rays of energy or light in spaceas described elsewhere in this disclosure.

FIG. 45A depicts an uncorrected visual acuity 45100A, which representshow a user with an uncorrected visual acuity perceives the real worldwithout any corrective lenses or visual adjustments. It should beappreciated that uncorrected visual acuities will vary by individual sothere are a multitude of possible uncorrected visual acuities. FIG. 45Ais included for demonstrative purposes and a 4D light field function canbe determined for the vision-correction device 44100 to account for manydifferent uncorrected visual acuities, as described elsewhere in thisdisclosure.

FIG. 45B illustrates a corrected visual acuity of a user viewing aholographic objected projected according to a 4D light field functiondetermined to account for an uncorrected visual acuity. The 4D lightfield function tailors the projection of the first holographic object45124B for the first user 45126B so he or she can view the firstholographic object 45124B with a first corrected visual acuity 45100B.This allows the first user 45126B to see the first holographic object45124B clearly without the use of prescriptive lenses or other visualaids. Embodiments allowing users to perceive objects with correctedvisual acuities can be combined with the other embodiments describedherein unless explicitly stated otherwise.

Some embodiments of the vision-correction device 46100A allow additionaltypes of objects to be projected other than holographic objects.Referring to FIG. 46A, in some embodiments, the control system 46122Acan operate the plurality of light sources of the light-source system46113A to direct light through the light-directing system 46102A toproject a two-dimensional object 46124A according to a 4D light fieldfunction determined to account for an uncorrected visual acuity of afirst user 46126A. This allows the first user 46126A to perceive the 2Dobject with a corrected visual acuity without the aid of correctivelenses. The 2D object 46124A can include a page from a book as depictedin FIG. 46A. This embodiment allows a user to clearly see a page of abook without corrected lenses when the same user would need correctivelenses or other visual aids to enjoy the book without thevision-corrective device of this disclosure. In some embodiments,successive pages of a book can be projected as successive 2D objectsallowing a user to read a book without corrective lenses.

A variety of techniques known in the art can be employed in differentembodiments either in isolation or in combination to allow the user tomove from page to page of a book. Some illustrative examples include,but are not limited to touch screens, remote controls, audio controls,and motion sensing, among others. Any other 2D objects can also beprojected, including, but not limited to a Snellen eye chart 46124B, asdepicted in the embodiment of the vision-correction device 46100B shownFIG. 46B. Embodiments of the vision-correction device 46100B allowsimultaneous projection of 2D objects and holographic objects.Embodiments of the vision-correction device 46100B that allowprojections of 2D objects can be combined with the other embodiments ofthis disclosure unless explicitly stated otherwise including but notlimited the energy waveguide system 44100.

Referring to FIG. 47, in some embodiments of the vision-correctionsystem 47100 of this disclosure, the control system 47122 can operatethe plurality of light sources of the light-source system 47113 todirect light through the light-directing system 47102 to project astereoscopic object 47124 according to a 4D light field functiondetermined to account for an uncorrected visual acuity of a first user47126. This allows the first user 47126 to perceive the stereoscopicobject with a corrected visual acuity without the aid of correctivelenses. In such embodiments, the user may use polarized glasses 47144,or other means known in the art to view the stereoscopic object 47124.Some embodiments of the vision-correction device may allow simultaneousprojection of any combination of holographic, 2D, or stereoscopicobjects. Embodiments of the vision-correction device 47100 that allowprojection of a stereoscopic object 47124 can also be combined with theother embodiments of this disclosure unless explicitly stated otherwiseincluding but not limited the energy-waveguides of FIGS. 23-26 and28-32.

It should also be appreciated by one skilled in the art that in additionto static, fixed objects, the vision-correction device may also allowfor successive projections of 2D, stereoscopic or holographic images orclips. In doing so this may allow viewers to watch 2D, stereoscopic, orholographic movies, television shows or other video content withoutcorrective lenses or other visual aids.

Embodiments of the vision-correction device described herein may allowmany different types of imperfections to be corrected independently orsimultaneously. This gives the vision-correction device advantages overtraditional corrective lenses. The teachings disclosed herein allowholographic, 2D, stereoscopic of other types of objects to be projectedaccording to a 4D light field function determined to account for anuncorrected visual acuity. The 4D light field function can account forusers suffering from myopia, hyperopia, astigmatisms, presbyopia orother vision problems and project a holographic, 2D, or stereoscopicobject that allows such users to perceive holographic, 2D, orstereoscopic objects with a corrected visual acuity.

However, many people may have more than one type of vision problem. Forexample, a user may have myopia and astigmatism. Another user may havemyopia and presbyopia. Still another user may have vision that requiresa different power of dioptric adjustment at different depths to correcttheir vision. For example, a single user's vision may require oneoptical power adjustment to correct objects at a distance of 40 feet,but require a second optical power adjustment to correct objects at adistance of 60 feet. A single-vision lens cannot account for more thanone vision problem at a time. Bifocal and multifocal lenses can helpcorrect more than one type of vision problem. But, multifocal lens canonly address a limited number of visual problems and can cause imagejumping when a user focuses through different areas of the multifocallenses.

Embodiments of the vision-correction device disclosed herein do not facethe same shortcomings because the vision-correction device may allowcontrol over the content of the light field projected by thevision-corrective device at the source of the light field rather thanattempting to introduce an outside element, like a lens, into anexisting light field to manipulate how the existing light field isreceived by the user into her or his eye.

FIG. 48A helps demonstrate this principle. The user 48126A has anuncorrected visual acuity 48100A. The projected object 48106A includesforeground objects 48102A and background objects 48104A. As depicted,both appear blurry to the user 48126A. A single-vision lens may onlycorrect for a vision problem at one of these two depths so either theforeground or the background may still appear blurry to users. FIG. 48Bdemonstrates a partially-corrected acuity 48100B where backgroundobjects 48104B are clear and foreground objects 48102B remain unclear inthe projected object 48106B to user 48126B. Another optical adjustmentmay produce a visual acuity where foreground objects are clear andbackground objects are unclear.

To help a user with multiple vision problems at multiple depths morethan one optical-power adjustment may be required, which is not possiblefor a single-focus lens. This is also problematic for a multi-focal lensbecause of image jumping, limited lens space for different opticalpowers, and manufacturing considerations. However, embodiments of thevision-correction device of this disclosure allow control over theprojected light that forms the foreground objects 48102C and thebackground objects 48104C of a projected object 48106C for user 48126C.This control allows the vision-correcting device to simultaneously makeindependent adjustments at both depths according to the 4D light fieldfunction determined to account for user's vision problems. This yields acorrected visual acuity 48100C, as depicted in FIG. 48C, where the user48126C is able to perceive both the foreground 48102C and the background48104C clearly. In some embodiments, the vision-correction device ofthis disclosure can therefore allow for simultaneous, independentadjustments to correct for multiple vision problems like myopia,hyperopia, astigmatism, and presbyopia. In one embodiment, the 4D lightfield function can account for the uncorrected visual acuity of theuser, where the uncorrected visual acuity includes correction by anoptical power correction. In some embodiments, the vision-correctiondevice may also allow for simultaneous optical-power corrections atmultiple depths. Unless explicitly stated to the contrary, theseembodiments may be combined with other embodiments described herein.

In an embodiment, the vision-correction device may also simultaneouslycorrect for different problems in different eyes. Individuals may needdifferent vision corrections for their left and right eyes. And, in manycases, the eye prescription needed to correct a person's vision may havedifferent optical power adjustments for left and right eyes. The 4Dlight field function can be determined to account for corrective needsthat vary from eye to eye and use eye-tracking technology, as describedelsewhere in this disclosure, to ensure that each eye receives lightinformation that allows a user to see a projected object with acorrected visual acuity in each eye as depicted in FIG. 49. Thevision-correction device 49100 can project a left object 49124Lcorrected for the specific visual problems of the user's 49126 left eye.And, the vision-correction device 49100 can project a right object49124R corrected for the specific visual problems of the user's 49126right eye. These embodiments can be combined with embodiments that allowfor simultaneous correction of multiple vision problems and simultaneouscorrection at multiple depths so the vision-corrective device cansimultaneously correct multiple vision problems at multiple depths ineach eye. And, unless explicitly stated otherwise, these embodiments canbe combined with the other embodiments of this disclosure.

Embodiments of the vision-corrective device 50100A also allow projectionof a second 2D, holographic, or stereo object. As depicted in FIG. 50Athe control system 50122A can be configured to operate the plurality oflight sources to direct light through the light-directing system 50102Ato project a first 2D, stereoscopic, or holographic object 50124A to afirst user 50126A, as already been described, and a second 2D,stereoscopic, or holographic 50124A′ object according to a second 4Dlight field function that has been determined to account for anuncorrected visual acuity of a second user 50126A′. This allows thesecond user 50126A′ to perceive the second holographic object 50124A′with a corrected visual acuity. Embodiments that allow the projection ofa second holographic object 50124A′ can also be combined with otherembodiments of the vision-correcting device disclosed herein to allowthe second 4D light field function to simultaneously account formultiple vision problems, simultaneously correct for vision problemsthat vary by depth, and simultaneously correct vision problems that varyfrom the right eye of the second user from the left eye of the seconduser.

The second 4D light field function may account for myopia, hyperopia,presbyopia, astigmatism and other eye conditions. These embodiments canalso be combined with embodiments discussed above that allow projectionof 2D objects, or stereoscopic objects. Like the 2D objects referencedabove, the second 2D object can also comprise pages of a book, or aSnellen eye chart. In some embodiments, the vision-correction device50100A allows the projection of a first holographic, 2D or stereoscopicobject that is perceived by a first user with a first corrected visualacuity tailored for the first user, and simultaneous projection of asecond holographic, 2D, or stereoscopic object that can be perceived bythe second user with a second corrected visual acuity tailored to thesecond user. These embodiments also allow the vision-correction device50100A to project multiple, additional holographic, 2D, or stereoscopicobjects that are determined by multiple, additional 4D light fieldfunctions to account for additional uncorrected visual acuities ofmultiple, additional users whereby the multiple, additional holographic,2D, or stereoscopic images are perceivable by the multiple, additionalviewers with corrected visual acuities. Embodiments allowing projectionof a second-holographic object may also be combined with embodimentsdiscussed elsewhere in this disclosure wherein there are second, andadditional propagation paths extending from additional waveguides thatsubstantially fill apertures of the waveguides. Combination withwaveguides that further comprise light-inhibiting elements such asbaffles is also allowed by this disclosure, and the discussions anddrawings relevant to the aforementioned embodiments are incorporatedherein. Finally, unless explicitly stated to the contrary, theseembodiments can be combined with the embodiments of this disclosure.

As depicted in FIG. 50A, in an embodiment the control system 50122A mayoperate the plurality of light sources of the light-source system 50113Ato direct light through the light-directing system 50102A to project afirst holographic, 2D, or stereoscopic object 50124A, according to afirst 4D light field function, to a first-viewing zone 50128A, and toproject a second holographic, 2D, or stereoscopic object 50124A′,according to a second 4D light field function, to a second-viewing zone50128A′. This may allow the first user 50126A to perceive the firstholographic object, 2D, or stereoscopic object 50124A with a correctedvisual acuity when the first user 50126 is located in the first-viewingzone 50128A. Further, it may also allow the second user 50126A′ toperceive the second holographic, 2D or stereoscopic object 50124A′ witha corrected visual acuity when the second user 50126A′ is located in thesecond-viewing zone 50128A′.

In an embodiment, the first 4D light field function is able to accountfor the location of the first user 50126A so that the first holographic,2D or stereoscopic object 50124A can be perceived by the first user50126A with the first corrected visual acuity when the first user 50126Ais at one of a continuum of distances for vision correction. In otherwords, the first 4D light field function is able to do this continuouslyregardless of the distance of the first-viewing zone 50128A from thelight-directing system 50102A. Likewise, in an embodiment, the second 4Dlight field function is able to account for the location of the seconduser 50126A′ so that the second holographic, 2D or stereoscopic object50124A′ can be perceived by the second user 50126A′ with the secondcorrected visual acuity when the second user 50126A′ is at one of acontinuum of distances for vision correction. In other words, the second4D light field function is able to do this continuously regardless ofthe distance of the second-viewing zone 50128A′ from the light-directingsystem 50102A.

In some instances, the second holographic, 2D, or stereoscopic object50124A′ may look blurry to the first user 50126A if the first user50126A is viewing the second holographic, 2D, or stereoscopic object50124A′ from the second-viewing zone 50128A′, assuming that the firstuser and second user require differing corrections of visual acuity.This is because the second 4D light field function is determined toaccount for the uncorrected visual acuity of the second user 50126A′ andwill not account for the uncorrected visual acuity of the first user50126A.

Likewise, the first holographic, 2D or stereoscopic object 50124A maylook blurry to the second user 50126A′, if the second user 50126A′ isviewing the first holographic, 2D, or stereoscopic object 50124A fromthe first-viewing zone 50128A. This is because the first 4D light fieldfunction is determined to account for the uncorrected visual acuity ofthe first user 50126A and may not account for the uncorrected visualacuity of the second user 50126A′. This can also provide a measure ofsecurity because holographic, 2D, or stereoscopic object projections canbe specifically calibrated for the vision of a specific user so they canperceive the holographic, 2D, or stereoscopic object with a correctedvisual acuity.

In operation, each of first user 50126A and second user 50126A′ may besitting in their respective viewing zones 50128A and 50128A′ while eachviews the object tailored to their own vision. The first object 50124Aand the second object 50124A′ can include alternate versions of the samecontent that may be individually calibrated for the vision of the firstuser 50126A and the second user 50126A′, respectively. In thealternative, the first object 50124A and the second objects 50124A′ caninclude separate content that the first user 50126A and the second user50126A′ can perceive while sitting side-by-side. In some embodiments,the vision-correction device may include multiple, additional viewingzones for the projection of multiple, additional objects as determinedby multiple, additional 4D light field functions to account for various,uncorrected visual acuities of multiple, additional users.

In an embodiment, the energy-sensing system may include an eye trackingsystem having an energy sensor 50130A as well as eye tracking softwarerun on the processor 50132A. The energy sensor 50130A of the eyetracking system or energy-sensing system may be a single camera, moremultiple cameras, a depth sensor, another type of imaging device, or anycombination of these devices, or other devices known in the art. Theenergy sensor 50130A may be external to the display, as shown in FIG.50A, as a device which may be placed on top of the display, to the sideof the display, or be integrated into the display as a bidirectionalenergy surface that simultaneously projects a light field and senseslight from the environment in front of the display surface, shown as50130B in FIG. 50B. In such an embodiment, the tracking processor 50132Bmay be configured to determine the location of the first user 50126B andthe second user 50126B′ based on data received from the eye trackingsystem energy sensor 50130B. The tracking processor 50132B may leveragealgorithms knowns in the art to analyze and process informationgenerated by the eye tracking system or energy-sensing system to trackthe location of the user 50126B, 50126B′. In some embodiments, thetracking processor 50132B may allow eye and retinal tracking of anyusers to allow targeted projections of light energy.

In some embodiments, the location of the first-viewing zone 50128A andthe location of the second-viewing zone 50128A′ may be determined by thepositions of the first user 50126A and second user 50126A′,respectively, which as discussed above, may be determined by anenergy-sensing system, which may optionally include an eye-trackingsystem. In other embodiments, the location of the first-viewing zone50128A and the second-viewing zone 50128A′ may move as the first user50126A and the second user 50126A′ is moving. The viewing zones mayfollow the users as they move and allows the first 50124A and second50124A′ holographic, 2D, or stereoscopic objects to be projected to theappropriate user. In other words, the tracking processor is able todynamically track the location of the first user and the second userbased on energy data received from an energy-sensing system, and wherethe location of the first-viewing zone 50128A may follow movement of thefirst user 50126A while the location of the second-viewing zone 50128A′may follow movement of the second user 50126A′. In other words, thetracking processor is able to do this whether the users 50126A, 50126A′are moving closer or further away from the vision-correction device.

In some embodiments, the vision-correction device may include multiple,additional objects and multiple, additional users with multiple,additional corresponding viewing zones that follow the respectivemultiple, additional users, as they move about. These embodiments canalso be combined with the other embodiments of this disclosure. Forexample, the 4D light field functions can each be determined tosimultaneously account for multiple vision problems, vision problemsthat vary by depth or by eye as discussed elsewhere in this disclosure.These embodiments can also be combined with the energy waveguides andall the light-inhibiting elements of this disclosure. Unless explicitlystated, all these embodiments may be combined with the other embodimentsof this disclosure. FIG. 50A is provided for descriptive purposes onlyand does not limit the embodiments of this disclosure.

As discussed above, the eye-tracking system energy sensor orenergy-sensing system 50130A may include a plurality of cameras forcapturing image data. In an embodiment, the energy-sensing system 50130Amay be a single camera. In another embodiment, the energy-sensing system50130A may include multiple cameras for capturing images at multipleangles. In such embodiments, the tracking processor may analyze datacaptured by the camera or cameras 50130A to determine the location ofthe first, second or any additional users so the vision-correctingdevice can project a holographic, 2D, or stereoscopic object accordingto a 4D light field function determined to account for the uncorrectedvisual acuities of each of the users to a viewing zone for that user soeach user can perceive the object with a corrected visual acuity.Additionally, the viewing zones may dynamically follow the users as theuser moves about as described elsewhere in this disclosure.

In an embodiment, the eye-tracking energy sensor or energy-sensingsystem 50130A may include at least one depth sensor. In operation, thetracking processor may analyze data generated by the depth sensor todetermine the location of the first, second or any additional multipleusers so the vision-correcting device can project a holographic, 2D, orstereoscopic object according to a 4D light field function determined toaccount for the uncorrected visual acuities of each of the users to aviewing zone for that user so each user can perceive the object with acorrected visual acuity. In some embodiments, the eye-tracking energysensor or energy-sensing system 50130A may include a combination of oneor more cameras and one or more depth sensors.

In operation, the eye-tracking system energy sensor or energy-sensingsystem 50130B may be configured to generate data describing a 4D lightfield function by sensing light received at the array of waveguides50134B as shown in FIG. 50B. In an embodiment, the display surface maybe a bi-directional energy surface configured to simultaneously senseimaging data and project holographic, 2D, and stereoscopic objects. Likeabove, the light-source system and light sensor locations may be behindthe waveguides 50134B within the light-directing system 50102B. Thetracking processor 50133A can analyze the data describing the 4D lightfield to determine the location of the first 50126B, second 50126B′ orany additional users so the vision-correcting device can project aholographic, 2D, or stereoscopic object 50124B, 50124B′ according to oneor more 4D light field functions determined to account for theindividual uncorrected visual acuity of each of the users.

Similar to above, the vision-correction device of FIG. 50B may include aprocessor 50132B having a tracking processor, the processor 50132B andthe tracking processor being distinctive units. And like above, theviewing zones maybe dynamically tracked as the users are moving via theeye-tracking energy sensor 50130B having one or more camera or depthsensor, and configured to sense energy received at the interface of thearray of waveguides 50134B. These embodiments may be combined with otherenergy-sensing system, energy waveguide system and light-inhibitingelements as disclosed herein allowing for a single user or singleviewing zone or for multiple users and multiple viewing zones.

As depicted in FIGS. 50A-50B, the vision-correcting device 50100 mayalso include a memory 50136 in communication with the control system50122. In some embodiments, the control system 50122 stores the 4D lightfield function in the memory 50136. The memory 50136 allows thevision-correcting device 50100 to store 4D light field functions thataccount for an individual user's 50126 uncorrected visual acuity. Thisallows the vision-correction device 50100 to access a 4D function lightfield function calibrated for a specific user 50126 so that user canview holographic, 2D, or stereoscopic objects 50124 with a correctedvisual acuity. In some embodiments, multiple 4D light field functionsthat correspond to multiple users can be stored on the memory 50136.And, data describing the 4D light field function can be received by thevision-correction device 50100 from any data-transfer method known inthe art. For example, data describing the 4D light field function can beuploaded from the Internet, a USB, or manually entered into a userinterface. Additionally, the 4D light field function can be calculatedby the vision-correction device 50100 as described in more detailelsewhere in this disclosure. Unless explicitly noted otherwise,embodiments of the vision-correction device that include a memory can becombined with the other embodiments described herein, e.g., memoryprocessor for carrying out the instructions for storing data andinformation, among others.

In one embodiment, a processor with the memory 50136 can be configuredto instruct the memory 50136 to store at least one additional 4D lightfield function where the at least one additional 4D light field functionis determined to account for a first uncorrected visual acuity of atleast one additional user, and where the processor is configured toinstruct the memory 50136 to associate at least one of a user name ofthe least one additional user, a user profile of the least oneadditional user, and a user identification of the least one additionaluser with the least one additional 4D light field function stored in thememory 50136.

In some embodiments, the vision-correction device 50100 may includerelay systems as described elsewhere throughout this disclosure and willnot be elaborated further herein. In an embodiment, the relay system mayinclude one or more relay elements, where each relay element has firstand second surfaces and configured to direct light emitted by theplurality of light sources along the plurality of propagation pathsthrough the first and second surfaces to the plurality of lightlocations. In some instances, like above, the second surfaces of therelay elements may be arranged to form a singular seamless energysurface.

As discussed above, the vision-corrective device may calculate the 4Dlight field function(s). An example of one such device is depicted inFIG. 51A. In an embodiment, the vision-correction device 51100A includesa light-source system 51113A having a plurality of light sources similarto other embodiments of this disclosure. As can be appreciated by aperson of ordinary skill in the art, a variety of different types oflight sources, as discussed elsewhere in this disclosure, may be used.

In an embodiment, the vision-correction device 51100A includes alight-directing system 51102A having an array of waveguides 51104A. Insome embodiments, the vision-correction device 51100A may or may notutilize waveguides as a component of the light directing system 51102A.And, as a person of ordinary skill in the art will appreciate, there maybe alternative embodiments that are consistent with the disclosures madeherein that may be used as the light-direction system.

In operation, light sources of the light-source system 51113A may bedirected from the array of waveguides 51104A along a plurality of lightpropagation paths 51106A. Each propagation path 51106A extends throughone of a plurality of light locations 51108A of the light-source system51113A. In an embodiment, a first waveguide 51110A of the array ofwaveguides 51104A is configured to direct light from a first lightlocation 51112A of the plurality of light locations 51108A along a firstpropagation path 51114A of the plurality of propagation paths 51106A.The first propagation path 51114A extends from the first waveguide51110A in a unique direction meaning it is the only propagation path toextend from the first waveguide 51110A in that direction. The uniquedirection is determined at least by the first light location 51112A.But, it should be appreciated that in other embodiments there may beadditional, or other, factors that determine the unique direction. Itshould also be noted that FIG. 51A represents a demonstrative exampleand does not limit the embodiments of this disclosure. Additionalembodiments with additional propagation paths, waveguides, andpropagation paths extending from additional unique directions may beused.

In one embodiment, the vision-correction device of FIG. 51A alsoincludes a control system 51122A configured to operate the plurality oflight sources of the light source system 51113A to direct light throughthe light-directing system 51102A to project a test object 51124A alongthe plurality of propagation paths 51106A. And like above, the devicemay include a processor 51138A configured to generate a 4D light fieldfunction from the progression of user inputs that is determined toaccount for an uncorrected visual acuity of the user 51126A.

In an embodiment, the device includes an interactive user interface51136A. In some embodiments, the interactive user interface 51136A mayinclude any types known in the art including but not limited to touchscreens, keyed inputs, voice recognition, tactile or gesture tracking,among others. The user interface 51136A may be configured to receive aprogression of inputs from a user 51126A for ranking the user'sperception of the visual clarity of the test object 51124A.

In operation, the control system 51122A may be configured to iterativelyadjust the test object 51124A as the user enters input into the userinterface 51136 ranking the visual clarity of the test object 51124A.Adjustments can include successive diopter and astigmatism correctionsdetermined by the progression of user inputs ranking the visual clarityof the test object 51124A. FIGS. 51A, 51B, and 51C demonstrate anexample of the iterative process.

FIG. 51B shows a first iteration of the test object 51124B as perceivedby the user 51126B. The user 51126B inputs data into the user interface51136B ranking the clarity of the first iteration of the test object51124B. If the user input indicates that adjustment is necessary, thecontrol system 51122B uses the input to make diopter or astigmatismcorrections to the test object 51124B to produce a second iteration ofthe test object 51124C as shown in FIG. 51C. Next, the user 51126C ranksthe clarity of the second iteration of the test object 51124C. Iffurther adjustment is necessary, the control system 51122C will makeadditional diopter or astigmatism corrections as determined by the userinput via the user interface 51136C, and this process will continueuntil the user perceives the test object 51124A as sufficiently clear,as shown in FIG. 51A. The processor 51138A then uses the progression ofuser inputs ranking the visual clarity of the iterations of the testobject 51124A to generate a 4D light field function determined toaccount for the eyesight of the user 51126A that accounts for theuncorrected visual acuity of that user. Embodiments of thevision-correction device 51100A that allow the vision-correction device51100A to calculate a 4D light field function determined to account forthe eyesight of a user—including embodiments with an interactive userinterface—can be combined with the other embodiments of this disclosureunless specifically denoted otherwise. This includes but is not limitedto waveguide energy systems, light inhibiting elements, andvision-correction devices that allow projection of holographic, 2D, orstereoscopic objects that are perceivable by a user, or users, with acorrected visual acuity or acuities.

Different ranking schemes can be utilized. In an embodiment, a user isallowed to rank the test object 51124A with each eye independently. Andthe control system 51122A can make adjustments and independently run theiterative process described above for each eye to create a progressionof user input that allows the processor 51138A to generate a 4D lightfield function that can simultaneously account for an uncorrected visualacuity for each of a user's 51126A two eyes. In other embodiments, theuncorrected visual acuity includes a left uncorrected visual acuity forthe left eye of the first user, and a right uncorrected visual acuityfor the right eye of the first user, and the 4D light field functionfurther simultaneously accounts for the left uncorrected visual acuityand for the right uncorrected visual acuity.

Some ranking schemes may also allow the vision-correction device 51100Ato calculate a 4D light field function to account for multiple visualimperfections that may occur at different depths, or visualimperfections that vary from the right and left eye of a user. As shownin FIG. 52, the test object 52106 may include a plurality of sub-objects52124A-52124E located at different depths, e.g., distances. The user canthen rank the visual clarity of each sub-object 52124A-52124E. And, asdescribed above, the control system can iteratively adjust eachsub-object 52124A-52124E until each sub-object 52124A-52124E issufficiently clear as shown in FIGS. 53-54. The progressive user inputcollected during the iterative adjustments allow the processor togenerate a 4D light field function determined to account for more thanone vision problem, and vision problems that vary at differentdistances. In some embodiments, each sub-object may iteratively beadjusted one at a time. And, in other embodiments, the user may rank allthe sub-objects in a single iteration of the test object. The nextiteration may include a test object where all the sub-objects have beenadjusted. In another embodiment, the first test object may include aplurality of sub-objects perceivable to the first user at acorresponding plurality of perceived distances, where the progression ofuser inputs from the first user ranks the visual clarity of theplurality of sub-objects. In other words, in an embodiment, theuncorrected visual acuity may include a plurality of uncorrected visualsub-acuities or sub-objects of a user where the user perceives allvisible objects equidistant to the user with the same uncorrected visualsub-acuity or sub-object, and where the 4D light field function furthersimultaneously accounts for the plurality of uncorrected visualsub-acuities or sub-objects by a plurality of simultaneous optical powercorrections, each optical power correction corresponding to anuncorrected visual sub-acuity or sub-object.

Embodiments ranking sub-objects or sub-acuities may be combined with theother embodiments disclosed herein unless explicitly stated otherwise.For example, embodiments that allow the user to rank the clarity of thetest object for each eye may also allow the user to rank the clarity ofa plurality of sub-objects for each eye to create a progression of userinputs that allow the processor to generate a 4D light field functionthat simultaneously accounts for multiple vision imperfections for eacheye that can vary at different depths.

In an embodiment, a method for calibrating a four dimensional (‘4D”)light field display operable to project a 2D, stereoscopic, orholographic object according to a 4D light field function for a userwith an uncorrected visual acuity is disclosed herein as depicted inFIG. 55. In one example, the method may include the use of a 4D lightfield display to project a test object 55110. The test object mayinclude a 2D, stereoscopic, or holographic object, among other. Next,the method may include a step S5120 to iteratively adjust the projectionof the test object according to a progression of user inputs evaluatingthe clarity of the test object. A user evaluates 55130 the clarity ofthe test object and inputs data into an interactive user interface. Instep S5140 it is determined whether the test object needs to be adjustedaccording to the user input entered in that iteration. If yes, then thetest object is adjusted in step S5150 and the user evaluates 55130 theadjusted test object again. This iterative process continues until it isdetermined in step S5140 that no more adjustments are needed and a 4Dlight field function is generated 55160 from the progression of userinputs. In operation, the 4D light field display employs the corrected4D light field function to calibrate holographic, 2D, or stereoscopicprojections to correct for any vision problems of the user.

In an embodiment, adjusting the test object includes a progression ofsuccessive diopter and astigmatism corrections. The test object caninclude a 2D or stereoscopic object. In some embodiments the test objectmay be a Snellen eye chart. In operation, the user evaluates the clarityof the test object by reading lines from the Snellen eye chart. The testobject can also include a plurality of sub-objects, each sub-objectbeing projected at a unique depth in the user's field of view. In otherembodiments, evaluating the clarity of the test object includesevaluating the clarity of each sub-object. The 4D light field functioncan be generated to account for myopia, hyperopia, astigmatism orpresbyopia in the uncorrected visual acuity of the user. In someembodiments, the 4D light field function can account for a user with aplurality of visual imperfections in the uncorrected visual acuity ofthe user, among others. In other embodiment, the method may be repeatedfor additional users to project additional holographic objectscalibrated to account for vision problems of the additional users.

The uncorrected visual acuity can include a left uncorrected visualacuity for the left eye of the user, and a right uncorrected visualacuity for the right eye of the user. In such cases, the 4D light fieldfunction may simultaneously accounts for the left uncorrected visualacuity and for the right uncorrected visual acuity. In some embodiments,the 4D light field function accounts for the uncorrected visual acuityof the user, where the uncorrected visual acuity may be correctable byan optical power correction. In other embodiments, the 4D light fieldfunction accounts for an uncorrected visual acuity of a user with aplurality of optical power adjustments that account for a plurality ofuncorrected visual sub-acuities of the user corresponding to vision at aplurality of different distances.

While various embodiments in accordance with the principles disclosedherein have been described above, it should be understood that they havebeen presented by way of example only, and are not limiting. Thus, thebreadth and scope of the invention(s) should not be limited by any ofthe above-described exemplary embodiments, but should be defined only inaccordance with the claims and their equivalents issuing from thisdisclosure. Furthermore, the above advantages and features are providedin described embodiments, but shall not limit the application of suchissued claims to processes and structures accomplishing any or all ofthe above advantages.

It will be understood that the principal features of this disclosure canbe employed in various embodiments without departing from the scope ofthe disclosure. Those skilled in the art will recognize, or be able toascertain using no more than routine experimentation, numerousequivalents to the specific procedures described herein. Suchequivalents are considered to be within the scope of this disclosure andare covered by the claims.

Additionally, the section headings herein are provided for consistencywith the suggestions under 37 CFR 1.77 or otherwise to provideorganizational cues. These headings shall not limit or characterize theinvention(s) set out in any claims that may issue from this disclosure.Specifically, and by way of example, although the headings refer to a“Field of Invention,” such claims should not be limited by the languageunder this heading to describe the so-called technical field. Further, adescription of technology in the “Background of the Invention” sectionis not to be construed as an admission that technology is prior art toany invention(s) in this disclosure. Neither is the “Summary” to beconsidered a characterization of the invention(s) set forth in issuedclaims. Furthermore, any reference in this disclosure to “invention” inthe singular should not be used to argue that there is only a singlepoint of novelty in this disclosure. Multiple inventions may be setforth according to the limitations of the multiple claims issuing fromthis disclosure, and such claims accordingly define the invention(s),and their equivalents, that are protected thereby. In all instances, thescope of such claims shall be considered on their own merits in light ofthis disclosure, but should not be constrained by the headings set forthherein.

The use of the word “a” or “an” when used in conjunction with the term“comprising” in the claims and/or the specification may mean “one,” butit is also consistent with the meaning of “one or more,” “at least one,”and “one or more than one.” The use of the term “or” in the claims isused to mean “and/or” unless explicitly indicated to refer toalternatives only or the alternatives are mutually exclusive, althoughthe disclosure supports a definition that refers to only alternativesand “and/or.” Throughout this application, the term “about” is used toindicate that a value includes the inherent variation of error for thedevice, the method being employed to determine the value, or thevariation that exists among the study subjects. In general, but subjectto the preceding discussion, a numerical value herein that is modifiedby a word of approximation such as “about” may vary from the statedvalue by at least ±1, 2, 3, 4, 5, 6, 7, 10, 12 or 15%.

As used in this specification and claim(s), the words “comprising” (andany form of comprising, such as “comprise” and “comprises”), “having”(and any form of having, such as “have” and “has”), “including” (and anyform of including, such as “includes” and “include”) or “containing”(and any form of containing, such as “contains” and “contain”) areinclusive or open-ended and do not exclude additional, unrecitedelements or method steps.

Words of comparison, measurement, and timing such as “at the time,”“equivalent,” “during,” “complete,” and the like should be understood tomean “substantially at the time,” “substantially equivalent,”“substantially during,” “substantially complete,” etc., where“substantially” means that such comparisons, measurements, and timingsare practicable to accomplish the implicitly or expressly stated desiredresult. Words relating to relative position of elements such as “near,”“proximate to,” and “adjacent to” shall mean sufficiently close to havea material effect upon the respective system element interactions. Otherwords of approximation similarly refer to a condition that when somodified is understood to not necessarily be absolute or perfect butwould be considered close enough to those of ordinary skill in the artto warrant designating the condition as being present. The extent towhich the description may vary will depend on how great a change can beinstituted and still have one of ordinary skilled in the art recognizethe modified feature as still having the required characteristics andcapabilities of the unmodified feature.

The term “or combinations thereof” as used herein refers to allpermutations and combinations of the listed items preceding the term.For example, “A, B, C, or combinations thereof is intended to include atleast one of: A, B, C, AB, AC, BC, or ABC, and if order is important ina particular context, also BA, CA, CB, CBA, BCA, ACB, BAC, or CAB.Continuing with this example, expressly included are combinations thatcontain repeats of one or more item or term, such as BB, AAA, AB, BBC,AAABCCCC, CBBAAA, CABABB, and so forth. The skilled artisan willunderstand that typically there is no limit on the number of items orterms in any combination, unless otherwise apparent from the context.

All of the compositions and/or methods disclosed and claimed herein canbe made and executed without undue experimentation in light of thepresent disclosure. While the compositions and methods of thisdisclosure have been described in terms of preferred embodiments, itwill be apparent to those of skill in the art that variations may beapplied to the compositions and/or methods and in the steps or in thesequence of steps of the method described herein without departing fromthe concept, spirit and scope of the disclosure. All such similarsubstitutes and modifications apparent to those skilled in the art aredeemed to be within the spirit, scope and concept of the disclosure asdefined by the appended claims.

What is claimed is:
 1. A device for vision correction, the devicecomprising: a light-source system configured to provide light to aplurality of light locations and comprising a plurality of lightsources; a light-directing system comprising; an array of waveguidesconfigured to direct light emitted by the plurality of light sourcesalong a plurality of propagation paths wherein each propagation pathextends through one of the plurality of light locations; and wherein afirst waveguide of the array of waveguides is configured to direct lightfrom a first light location through the first waveguide along a firstpropagation path of the plurality of propagation paths wherein the firstpropagation path extends from the first waveguide in a unique directiondetermined at least by the first light location; and a control systemconfigured to operate the plurality of light sources to direct lightthrough the light-directing system to project a first holographic objectalong the plurality of propagation paths according to a four-dimensional(“4D”) light field function that has been determined to account for anuncorrected visual acuity of a first user, whereby the first holographicobject is perceivable by the first user with a first corrected visualacuity without corrective eyewear configured according to a correctiveprescriptive function that would correct the uncorrected visual acuityof the first user.
 2. The device of claim 1, wherein the first waveguidedefines a two-dimensional (“2D”) spatial coordinate, and wherein theunique direction determined at least by the first light locationcomprises a two-dimensional angular coordinate, whereby the 2D spatialcoordinate and the 2D angular coordinate form a 4D light fieldcoordinate set.
 3. The device of claim 1, wherein the control system isfurther configured to operate the plurality of light sources to directlight through the light-directing system to project a first 2D objectaccording to the 4D light field function that has been determined toaccount for the uncorrected visual acuity of the first user, whereby theprojected object is perceivable by the first user with the firstcorrected visual acuity.
 4. The device of claim 3, wherein the first 2Dobject comprises at least one of a page of a book and a Snellen eyechart.
 5. The device of claim 1, wherein the control system is furtherconfigured to operate the plurality of light sources to direct lightthrough the light-directing system to project a first stereoscopicobject according to the 4D light field function that has been determinedto account for the uncorrected visual acuity of the first user, wherebythe first stereoscopic object is perceivable by the first user with thefirst corrected visual acuity.
 6. The device of claim 1, wherein the 4Dlight field function accounts for at least one of myopia, hyperopia,astigmatism, presbyopia, and a plurality of visual imperfections in theuncorrected visual acuity of the first user.
 7. The device of claim 1,wherein the uncorrected visual acuity comprises a plurality ofuncorrected visual sub-acuities of the first user wherein the first userperceives all visible objects equidistant to the first user with thesame uncorrected visual sub-acuity, and further wherein the 4D lightfield function simultaneously accounts for the plurality of uncorrectedvisual sub-acuities by a plurality of simultaneous optical powercorrections, each optical power correction corresponding to anuncorrected visual sub-acuity.
 8. The device of claim 1 wherein thelight-source system further comprises a relay system, wherein the relaysystem comprises one or more relay elements, wherein each of the one ormore relay elements comprises a first surface and a second surface, andwherein the plurality of light sources are disposed at the secondsurface of the one or more relay elements, the one or more relayelements configured to direct light emitted by the plurality of lightsources through the first and second surfaces to the plurality of lightlocations.